Jul 16 22:13:53.784353 ip-10-0-132-127 systemd[1]: Starting Kubernetes Kubelet... Jul 16 22:13:54.157415 ip-10-0-132-127 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 22:13:54.157415 ip-10-0-132-127 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 22:13:54.157415 ip-10-0-132-127 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 22:13:54.157415 ip-10-0-132-127 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 22:13:54.157415 ip-10-0-132-127 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 22:13:54.159144 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.159045 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 22:13:54.163510 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163495 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 22:13:54.163510 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163510 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163515 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163519 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163522 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163525 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163528 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163538 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163541 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163543 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163546 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163549 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163551 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163554 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163557 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163559 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163562 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163565 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163567 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163570 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163572 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 22:13:54.163569 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163575 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163578 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163580 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163584 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163586 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163589 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163592 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163594 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163597 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163599 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163602 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163604 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163608 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163610 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163613 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163615 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163618 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163620 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163623 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163626 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 16 22:13:54.164032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163628 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 22:13:54.164523 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163631 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 22:13:54.164523 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163633 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 22:13:54.164523 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163636 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 22:13:54.164523 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163638 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 22:13:54.164523 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163640 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 22:13:54.164523 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163643 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 22:13:54.164523 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163645 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 22:13:54.164523 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163648 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 22:13:54.164523 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163651 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 22:13:54.164523 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163653 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 22:13:54.164523 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163656 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 22:13:54.164523 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163659 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 22:13:54.164523 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163662 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 22:13:54.164523 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163664 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 22:13:54.164523 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163667 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 22:13:54.164523 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163669 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 22:13:54.164523 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163672 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 22:13:54.164523 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163674 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 22:13:54.164523 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163677 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 22:13:54.164978 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163679 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 22:13:54.164978 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163682 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 22:13:54.164978 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163684 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 22:13:54.164978 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163687 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 22:13:54.164978 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163690 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 22:13:54.164978 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163692 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 22:13:54.164978 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163695 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 22:13:54.164978 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163697 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 22:13:54.164978 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163700 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 22:13:54.164978 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163702 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 22:13:54.164978 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163705 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 22:13:54.164978 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163708 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 22:13:54.164978 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163711 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 22:13:54.164978 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163713 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 22:13:54.164978 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163717 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 22:13:54.164978 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163721 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 22:13:54.164978 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163724 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 22:13:54.164978 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163726 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 22:13:54.164978 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163730 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 22:13:54.165435 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163733 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 22:13:54.165435 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163735 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 22:13:54.165435 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163739 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 22:13:54.165435 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163743 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 22:13:54.165435 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163747 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 22:13:54.165435 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163751 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 22:13:54.165435 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163755 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 22:13:54.165435 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163758 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 22:13:54.165435 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163761 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 22:13:54.165435 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163764 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 22:13:54.165435 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163766 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 22:13:54.165435 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163769 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 22:13:54.165435 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163772 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 22:13:54.165435 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163774 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 22:13:54.165435 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163777 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 22:13:54.165435 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163779 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 22:13:54.165435 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163782 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 22:13:54.165435 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163785 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 22:13:54.165435 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.163787 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 22:13:54.166181 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166170 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 22:13:54.166181 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166181 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 22:13:54.166236 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166184 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 22:13:54.166236 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166187 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 22:13:54.166236 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166190 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 22:13:54.166236 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166194 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 22:13:54.166236 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166198 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 22:13:54.166236 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166202 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 22:13:54.166236 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166206 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 22:13:54.166236 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166209 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 22:13:54.166236 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166211 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 22:13:54.166236 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166214 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 22:13:54.166236 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166217 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 22:13:54.166236 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166220 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 22:13:54.166236 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166223 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 22:13:54.166236 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166226 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 22:13:54.166236 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166228 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 22:13:54.166236 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166231 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 22:13:54.166236 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166233 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 22:13:54.166236 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166236 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 22:13:54.166236 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166240 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166243 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166247 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166250 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166253 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166256 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166259 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166262 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166264 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166267 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166269 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166273 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166275 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166278 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166280 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166283 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166285 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166288 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166291 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166293 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 22:13:54.166705 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166296 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 22:13:54.167221 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166298 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 22:13:54.167221 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166301 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 22:13:54.167221 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166303 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 22:13:54.167221 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166305 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 22:13:54.167221 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166308 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 22:13:54.167221 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166311 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 22:13:54.167221 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166315 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 22:13:54.167221 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166317 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 22:13:54.167221 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166320 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 22:13:54.167221 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166323 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 22:13:54.167221 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166326 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 22:13:54.167221 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166328 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 22:13:54.167221 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166330 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 22:13:54.167221 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166334 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 22:13:54.167221 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166337 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 22:13:54.167221 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166340 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 22:13:54.167221 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166343 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 22:13:54.167221 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166346 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 22:13:54.167221 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166349 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166351 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166354 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166356 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166358 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166361 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166363 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166366 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166368 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166371 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166373 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166376 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166379 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166381 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166384 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166386 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166389 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166392 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166394 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166397 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 22:13:54.167679 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166399 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166401 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166404 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166406 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166408 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166411 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166413 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166416 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166419 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166422 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166425 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166427 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166429 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166432 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166434 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166437 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166440 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166442 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166444 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166447 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 22:13:54.168169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166790 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 22:13:54.168645 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166797 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 22:13:54.168645 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166800 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 22:13:54.168645 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166803 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 22:13:54.168645 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166807 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 22:13:54.168645 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166810 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 22:13:54.168645 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166813 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 22:13:54.168645 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166816 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 22:13:54.168645 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166819 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 22:13:54.168645 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166821 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 22:13:54.168645 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166825 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 22:13:54.168645 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166829 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 22:13:54.168645 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166831 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 22:13:54.168645 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166834 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 22:13:54.168645 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166836 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 22:13:54.168645 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166838 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 22:13:54.168645 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166841 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 22:13:54.168645 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166843 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 22:13:54.168645 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166846 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 22:13:54.168645 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166850 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166852 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166855 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166857 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166860 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166862 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166865 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166867 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166870 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166872 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166875 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166877 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166880 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166882 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166885 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166887 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166889 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166892 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166896 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166898 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 22:13:54.169131 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166901 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166903 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166905 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166908 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166911 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166913 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166916 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166918 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166920 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166923 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166926 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166928 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166931 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166933 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166936 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166938 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166941 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166944 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166947 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166949 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 22:13:54.169610 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166952 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166955 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166957 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166960 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166962 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166965 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166967 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166970 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166972 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166975 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166977 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166980 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166982 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166985 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166987 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166990 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166992 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166995 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.166997 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167000 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 22:13:54.170125 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167002 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167015 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167017 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167020 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167026 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167029 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167032 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167034 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167037 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167039 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167042 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167046 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167048 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167052 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167055 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167058 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167061 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167063 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167066 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167081 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 22:13:54.170598 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167165 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167172 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167178 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167182 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167187 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167190 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167194 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167198 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167201 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167204 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167208 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167211 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167214 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167217 2578 flags.go:64] FLAG: --cgroup-root="" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167220 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167223 2578 flags.go:64] FLAG: --client-ca-file="" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167228 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167231 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167235 2578 flags.go:64] FLAG: --cluster-domain="" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167238 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167241 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167244 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167248 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167251 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 22:13:54.171102 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167255 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167258 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167261 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167264 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167267 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167270 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167273 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167276 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167280 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167282 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167285 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167288 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167291 2578 flags.go:64] FLAG: --enable-server="true" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167294 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167299 2578 flags.go:64] FLAG: --event-burst="100" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167302 2578 flags.go:64] FLAG: --event-qps="50" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167305 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167308 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167310 2578 flags.go:64] FLAG: --eviction-hard="" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167314 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167317 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167320 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167322 2578 flags.go:64] FLAG: --eviction-soft="" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167325 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167328 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 22:13:54.171696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167331 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167334 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167337 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167339 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167347 2578 flags.go:64] FLAG: --feature-gates="" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167351 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167354 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167357 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167360 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167363 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167366 2578 flags.go:64] FLAG: --help="false" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167369 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-132-127.ec2.internal" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167372 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167375 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167378 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167381 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167384 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167387 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167390 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167392 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167395 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167398 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167402 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167404 2578 flags.go:64] FLAG: --kube-reserved="" Jul 16 22:13:54.172344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167407 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167410 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167413 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167416 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167418 2578 flags.go:64] FLAG: --lock-file="" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167421 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167424 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167427 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167432 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167435 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167438 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167441 2578 flags.go:64] FLAG: --logging-format="text" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167445 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167448 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167451 2578 flags.go:64] FLAG: --manifest-url="" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167454 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167458 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167461 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167465 2578 flags.go:64] FLAG: --max-pods="110" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167468 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167471 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167474 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167477 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167480 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167483 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 22:13:54.172933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167485 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167492 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167495 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167498 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167501 2578 flags.go:64] FLAG: --pod-cidr="" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167504 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167509 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167513 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167516 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167518 2578 flags.go:64] FLAG: --port="10250" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167522 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167525 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02f96d067e70323e6" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167528 2578 flags.go:64] FLAG: --qos-reserved="" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167531 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167533 2578 flags.go:64] FLAG: --register-node="true" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167536 2578 flags.go:64] FLAG: --register-with-taints="" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167540 2578 flags.go:64] FLAG: --registry-burst="10" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167542 2578 flags.go:64] FLAG: --registry-qps="5" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167545 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167549 2578 flags.go:64] FLAG: --reserved-memory="" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167553 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167555 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167558 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167561 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167564 2578 flags.go:64] FLAG: --runonce="false" Jul 16 22:13:54.173565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167566 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167569 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167572 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167575 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167578 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167581 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167584 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167587 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167589 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167592 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167595 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167597 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167600 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167604 2578 flags.go:64] FLAG: --system-cgroups="" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167607 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167611 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167614 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167617 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167621 2578 flags.go:64] FLAG: --tls-min-version="" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167623 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167626 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167629 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167632 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167635 2578 flags.go:64] FLAG: --v="2" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167638 2578 flags.go:64] FLAG: --version="false" Jul 16 22:13:54.174208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167642 2578 flags.go:64] FLAG: --vmodule="" Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167647 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.167650 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167761 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167765 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167768 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167771 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167774 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167777 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167780 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167783 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167786 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167789 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167791 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167794 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167797 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167799 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167801 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167804 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167807 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 22:13:54.174803 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167809 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167812 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167815 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167817 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167821 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167823 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167826 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167828 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167831 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167834 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167836 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167839 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167841 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167845 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167847 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167850 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167853 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167855 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167858 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167860 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 22:13:54.175353 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167863 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167865 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167867 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167870 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167872 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167875 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167877 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167880 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167883 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167886 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167889 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167892 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167894 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167897 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167900 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167902 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167906 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167908 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167911 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167914 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 22:13:54.175824 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167916 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 22:13:54.176325 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167919 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 22:13:54.176325 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167921 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 22:13:54.176325 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167924 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 22:13:54.176325 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167926 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 22:13:54.176325 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167930 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 22:13:54.176325 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167932 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 22:13:54.176325 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167935 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 22:13:54.176325 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167938 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 22:13:54.176325 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167940 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 22:13:54.176325 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167943 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 22:13:54.176325 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167946 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 22:13:54.176325 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167948 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 22:13:54.176325 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167951 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 22:13:54.176325 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167953 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 16 22:13:54.176325 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167956 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 22:13:54.176325 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167958 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 22:13:54.176325 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167961 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 22:13:54.176325 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167963 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 22:13:54.176325 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167966 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 22:13:54.176778 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167968 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 22:13:54.176778 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167971 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 22:13:54.176778 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167973 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 22:13:54.176778 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167976 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 22:13:54.176778 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167978 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 22:13:54.176778 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167981 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 22:13:54.176778 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167983 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 22:13:54.176778 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167986 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 22:13:54.176778 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167990 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 22:13:54.176778 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167993 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 22:13:54.176778 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.167997 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 22:13:54.176778 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.168000 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 22:13:54.176778 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.168003 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 22:13:54.176778 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.168007 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 22:13:54.176778 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.168010 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 22:13:54.176778 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.168013 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 22:13:54.176778 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.168016 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 22:13:54.176778 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.168020 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 22:13:54.176778 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.168023 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 22:13:54.177234 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.168026 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 22:13:54.177234 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.168028 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 22:13:54.177234 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.168031 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 22:13:54.177234 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.168689 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 22:13:54.177234 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.175327 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 22:13:54.177234 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.175341 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 22:13:54.177234 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.176294 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 22:13:54.177234 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.176302 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 22:13:54.177234 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176356 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 22:13:54.177234 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176362 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 22:13:54.177234 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176365 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 22:13:54.177234 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176368 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 22:13:54.177234 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176371 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 22:13:54.177234 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176374 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 22:13:54.177234 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176376 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 22:13:54.177843 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176379 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 22:13:54.177843 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176382 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 22:13:54.177843 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176385 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 22:13:54.177843 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176388 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 22:13:54.177843 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176390 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 22:13:54.177843 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176393 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 22:13:54.177843 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176396 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 22:13:54.177843 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176398 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 22:13:54.177843 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176401 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 22:13:54.177843 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176404 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 22:13:54.177843 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176406 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 22:13:54.177843 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176409 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 22:13:54.177843 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176412 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 22:13:54.177843 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176414 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 22:13:54.177843 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176416 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 22:13:54.177843 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176419 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 22:13:54.177843 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176422 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 22:13:54.177843 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176425 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 22:13:54.177843 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176427 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 22:13:54.178490 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176430 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 22:13:54.178490 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176432 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 22:13:54.178490 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176435 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 22:13:54.178490 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176439 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 22:13:54.178490 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176442 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 22:13:54.178490 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176444 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 22:13:54.178490 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176447 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 22:13:54.178490 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176449 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 22:13:54.178490 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176452 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 22:13:54.178490 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176454 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 22:13:54.178490 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176457 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 22:13:54.178490 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176459 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 22:13:54.178490 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176461 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 22:13:54.178490 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176464 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 22:13:54.178490 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176466 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 22:13:54.178490 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176470 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 22:13:54.178490 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176474 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 22:13:54.178490 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176476 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 22:13:54.178490 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176479 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176483 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176485 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176487 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176490 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176492 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176495 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176498 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176500 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176503 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176505 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176508 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176510 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176513 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176515 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176518 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176520 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176523 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176526 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176528 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 22:13:54.178948 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176531 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 22:13:54.179456 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176533 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 22:13:54.179456 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176536 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 22:13:54.179456 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176538 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 22:13:54.179456 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176541 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 22:13:54.179456 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176543 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 22:13:54.179456 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176546 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 22:13:54.179456 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176549 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 22:13:54.179456 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176553 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 22:13:54.179456 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176556 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 22:13:54.179456 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176559 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 22:13:54.179456 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176562 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 22:13:54.179456 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176566 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 22:13:54.179456 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176568 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 22:13:54.179456 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176572 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 22:13:54.179456 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176574 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 22:13:54.179456 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176577 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 22:13:54.179456 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176579 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 22:13:54.179456 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176582 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 22:13:54.179456 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176584 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 22:13:54.179897 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176586 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 22:13:54.179897 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176589 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 16 22:13:54.179897 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176592 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 22:13:54.179897 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176594 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 22:13:54.179897 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176596 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 22:13:54.179897 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176599 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 22:13:54.179897 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176601 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 22:13:54.179897 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176604 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 22:13:54.179897 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176606 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 22:13:54.179897 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176609 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 22:13:54.179897 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176612 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 22:13:54.179897 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176614 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 22:13:54.179897 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176617 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 22:13:54.179897 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176620 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 22:13:54.179897 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176622 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 22:13:54.180421 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.176628 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 22:13:54.180421 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176732 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 22:13:54.180421 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176737 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 22:13:54.180421 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176740 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 22:13:54.180421 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176743 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 22:13:54.180421 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176746 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 22:13:54.180421 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176749 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 22:13:54.180421 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176752 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 22:13:54.180421 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176756 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 22:13:54.180421 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176759 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 22:13:54.180421 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176762 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 22:13:54.180421 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176764 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 22:13:54.180421 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176768 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 22:13:54.180421 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176771 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 22:13:54.180421 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176774 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176776 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176779 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176782 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176784 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176787 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176789 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176792 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176795 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176798 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176800 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176802 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176805 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176807 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176810 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176812 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176815 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176817 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176819 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176822 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 22:13:54.180784 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176824 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 22:13:54.181270 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176827 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 22:13:54.181270 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176829 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 22:13:54.181270 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176831 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 22:13:54.181270 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176834 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 22:13:54.181270 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176837 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 22:13:54.181270 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176841 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 22:13:54.181270 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176843 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 22:13:54.181270 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176846 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 22:13:54.181270 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176849 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 22:13:54.181270 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176851 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 22:13:54.181270 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176855 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 22:13:54.181270 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176858 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 22:13:54.181270 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176861 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 22:13:54.181270 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176864 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 22:13:54.181270 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176867 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 22:13:54.181270 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176870 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 22:13:54.181270 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176873 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 22:13:54.181270 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176875 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 22:13:54.181270 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176878 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176880 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176883 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176886 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176888 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176891 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176894 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176897 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176899 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176902 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176904 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176907 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176909 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176911 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176914 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176916 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176918 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176921 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176923 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176926 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 22:13:54.181715 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176928 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176931 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176933 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176936 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176938 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176941 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176943 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176946 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176948 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176951 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176953 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176956 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176958 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176961 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176963 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176965 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176968 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176971 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176976 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176978 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 22:13:54.182208 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176981 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 22:13:54.182772 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176983 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 22:13:54.182772 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176986 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 22:13:54.182772 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176989 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 22:13:54.182772 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176991 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 22:13:54.182772 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176994 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 22:13:54.182772 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:54.176996 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 22:13:54.182772 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.177001 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 22:13:54.182772 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.177117 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 22:13:54.182772 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.179705 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 22:13:54.182772 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.181039 2578 server.go:1019] "Starting client certificate rotation" Jul 16 22:13:54.182772 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.181099 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 22:13:54.182772 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.181863 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 22:13:54.183375 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.183361 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 22:13:54.185725 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.185712 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 22:13:54.197491 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.197471 2578 log.go:25] "Validated CRI v1 runtime API" Jul 16 22:13:54.199490 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.199475 2578 log.go:25] "Validated CRI v1 image API" Jul 16 22:13:54.200328 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.200308 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 22:13:54.204849 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.204826 2578 fs.go:135] Filesystem UUIDs: map[13601a5f-ad3a-4fcf-8644-5f3ff810d49d:/dev/nvme0n1p4 7096909d-1f5c-4597-a646-ecd72e302cff:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 16 22:13:54.204914 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.204849 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 22:13:54.210692 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.210589 2578 manager.go:216] Machine: {Timestamp:2026-07-16 22:13:54.208537471 +0000 UTC m=+0.311182710 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094691 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec204c422692d84ca58eb9bd93f1af6d SystemUUID:ec204c42-2692-d84c-a58e-b9bd93f1af6d BootID:6f9217ac-b755-4004-bc0d-35f56bae452f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b9:74:57:80:79 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b9:74:57:80:79 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:27:13:4e:b3:93 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 22:13:54.210692 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.210690 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 22:13:54.210802 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.210760 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 22:13:54.211286 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.211272 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 22:13:54.213853 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.213824 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 22:13:54.214012 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.213861 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-127.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 22:13:54.215018 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.215001 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 22:13:54.215052 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.215021 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 22:13:54.215052 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.215029 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 22:13:54.215712 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.215702 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 22:13:54.216789 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.216780 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 22:13:54.219895 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.219883 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 16 22:13:54.220038 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.220028 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 22:13:54.220101 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.220093 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 16 22:13:54.220131 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.220108 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 22:13:54.220131 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.220121 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 22:13:54.220131 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.220129 2578 kubelet.go:398] "Adding apiserver pod source" Jul 16 22:13:54.220223 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.220137 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 22:13:54.220525 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.220511 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 22:13:54.220578 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.220537 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 22:13:54.224372 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.224355 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 22:13:54.226275 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.226260 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 22:13:54.226338 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.226289 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 22:13:54.227271 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.227260 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 22:13:54.227323 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.227276 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 22:13:54.227323 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.227282 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 22:13:54.227323 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.227287 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 22:13:54.227323 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.227295 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 22:13:54.227323 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.227300 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 22:13:54.227323 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.227308 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 22:13:54.227323 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.227313 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 22:13:54.227323 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.227320 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 22:13:54.227323 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.227325 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 22:13:54.227546 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.227333 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 22:13:54.227546 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.227339 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 22:13:54.228471 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.228461 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 22:13:54.228471 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.228471 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 22:13:54.231669 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.231651 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-127.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 22:13:54.231749 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.231687 2578 server.go:1268] "Started kubelet" Jul 16 22:13:54.231891 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.231821 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 22:13:54.231943 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.231917 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 22:13:54.232276 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.232230 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 22:13:54.232276 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.232229 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-127.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 22:13:54.232384 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.232329 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 22:13:54.232452 ip-10-0-132-127 systemd[1]: Started Kubernetes Kubelet. Jul 16 22:13:54.233227 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.233140 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-df74z" Jul 16 22:13:54.233678 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.233665 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 22:13:54.234120 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.234104 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 16 22:13:54.237579 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.236576 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-127.ec2.internal.18c2e4db9a68c397 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-127.ec2.internal,UID:ip-10-0-132-127.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-127.ec2.internal,},FirstTimestamp:2026-07-16 22:13:54.231665559 +0000 UTC m=+0.334310776,LastTimestamp:2026-07-16 22:13:54.231665559 +0000 UTC m=+0.334310776,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-127.ec2.internal,}" Jul 16 22:13:54.237819 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.237804 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 22:13:54.241212 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.241198 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 22:13:54.241212 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.241204 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 22:13:54.241460 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.241426 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-127.ec2.internal\" not found" Jul 16 22:13:54.241537 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.241476 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-df74z" Jul 16 22:13:54.241975 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.241834 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 22:13:54.241975 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.241837 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 22:13:54.241975 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.241864 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 22:13:54.242185 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.242050 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 16 22:13:54.242185 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.242060 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 16 22:13:54.242335 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.242319 2578 factory.go:55] Registering systemd factory Jul 16 22:13:54.242335 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.242335 2578 factory.go:223] Registration of the systemd container factory successfully Jul 16 22:13:54.242660 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.242643 2578 factory.go:153] Registering CRI-O factory Jul 16 22:13:54.242660 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.242661 2578 factory.go:223] Registration of the crio container factory successfully Jul 16 22:13:54.242794 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.242738 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 22:13:54.242794 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.242776 2578 factory.go:103] Registering Raw factory Jul 16 22:13:54.242794 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.242789 2578 manager.go:1196] Started watching for new ooms in manager Jul 16 22:13:54.243577 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.243562 2578 manager.go:349] Starting recovery of all containers Jul 16 22:13:54.251084 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.251043 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 22:13:54.254130 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.254110 2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-127.ec2.internal\" not found" node="ip-10-0-132-127.ec2.internal" Jul 16 22:13:54.255425 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.255410 2578 manager.go:354] Recovery completed Jul 16 22:13:54.256667 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.256649 2578 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": readdirent /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 16 22:13:54.259822 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.259808 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 22:13:54.261396 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.261381 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasSufficientMemory" Jul 16 22:13:54.261452 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.261409 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 22:13:54.261452 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.261420 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasSufficientPID" Jul 16 22:13:54.261894 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.261881 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 22:13:54.261894 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.261891 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 22:13:54.261894 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.261894 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 22:13:54.262090 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.261913 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 16 22:13:54.262863 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.262852 2578 policy_none.go:49] "None policy: Start" Jul 16 22:13:54.262923 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.262869 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 22:13:54.262923 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.262883 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 22:13:54.263631 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.263616 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasSufficientMemory" Jul 16 22:13:54.263675 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.263642 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 22:13:54.263675 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.263651 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasSufficientPID" Jul 16 22:13:54.263818 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.263806 2578 policy_none.go:47] "Start" Jul 16 22:13:54.301736 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.301602 2578 manager.go:337] "Starting Device Plugin manager" Jul 16 22:13:54.301820 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.301758 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 22:13:54.301820 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.301772 2578 server.go:87] "Starting device plugin registration server" Jul 16 22:13:54.301974 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.301962 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 22:13:54.302019 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.301974 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 22:13:54.302114 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.302091 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 22:13:54.302225 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.302206 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 22:13:54.302225 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.302220 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 22:13:54.302762 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.302747 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 22:13:54.302837 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.302788 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-127.ec2.internal\" not found" Jul 16 22:13:54.403179 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.403160 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 22:13:54.404107 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.404090 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasSufficientMemory" Jul 16 22:13:54.404201 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.404122 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 22:13:54.404201 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.404133 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasSufficientPID" Jul 16 22:13:54.404201 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.404161 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-127.ec2.internal" Jul 16 22:13:54.412217 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.412178 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-127.ec2.internal" Jul 16 22:13:54.412217 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.412202 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-127.ec2.internal\": node \"ip-10-0-132-127.ec2.internal\" not found" Jul 16 22:13:54.422913 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.422878 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 22:13:54.424176 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.424136 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 22:13:54.424253 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.424204 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 22:13:54.424253 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.424230 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 22:13:54.424387 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.424272 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 22:13:54.426557 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.426537 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 22:13:54.431457 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.431441 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-127.ec2.internal\" not found" Jul 16 22:13:54.527203 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.527153 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-127.ec2.internal"] Jul 16 22:13:54.527294 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.527249 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 22:13:54.528205 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.528190 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasSufficientMemory" Jul 16 22:13:54.528282 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.528221 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 22:13:54.528282 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.528232 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasSufficientPID" Jul 16 22:13:54.529605 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.529592 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 22:13:54.529720 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.529706 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal" Jul 16 22:13:54.529764 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.529739 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 22:13:54.530391 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.530373 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasSufficientMemory" Jul 16 22:13:54.530503 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.530373 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasSufficientMemory" Jul 16 22:13:54.530503 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.530419 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 22:13:54.530503 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.530432 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasSufficientPID" Jul 16 22:13:54.530503 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.530400 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 22:13:54.530503 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.530492 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasSufficientPID" Jul 16 22:13:54.531710 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.531694 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-127.ec2.internal\" not found" Jul 16 22:13:54.532199 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.532185 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-127.ec2.internal" Jul 16 22:13:54.532244 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.532214 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 22:13:54.533025 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.533007 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasSufficientMemory" Jul 16 22:13:54.533106 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.533038 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 22:13:54.533106 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.533050 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeHasSufficientPID" Jul 16 22:13:54.547725 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.547705 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-127.ec2.internal\" not found" node="ip-10-0-132-127.ec2.internal" Jul 16 22:13:54.552438 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.552424 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-127.ec2.internal\" not found" node="ip-10-0-132-127.ec2.internal" Jul 16 22:13:54.632728 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.632705 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-127.ec2.internal\" not found" Jul 16 22:13:54.643655 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.643636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bfecc055662ef0ce2b1d85dad656ceb0-config\") pod \"kube-apiserver-proxy-ip-10-0-132-127.ec2.internal\" (UID: \"bfecc055662ef0ce2b1d85dad656ceb0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-127.ec2.internal" Jul 16 22:13:54.643713 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.643661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8eccaf406c63ad056385422d786042ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal\" (UID: \"8eccaf406c63ad056385422d786042ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal" Jul 16 22:13:54.643713 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.643680 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8eccaf406c63ad056385422d786042ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal\" (UID: \"8eccaf406c63ad056385422d786042ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal" Jul 16 22:13:54.733434 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.733397 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-127.ec2.internal\" not found" Jul 16 22:13:54.744585 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.744561 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bfecc055662ef0ce2b1d85dad656ceb0-config\") pod \"kube-apiserver-proxy-ip-10-0-132-127.ec2.internal\" (UID: \"bfecc055662ef0ce2b1d85dad656ceb0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-127.ec2.internal" Jul 16 22:13:54.744641 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.744530 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bfecc055662ef0ce2b1d85dad656ceb0-config\") pod \"kube-apiserver-proxy-ip-10-0-132-127.ec2.internal\" (UID: \"bfecc055662ef0ce2b1d85dad656ceb0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-127.ec2.internal" Jul 16 22:13:54.744678 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.744647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8eccaf406c63ad056385422d786042ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal\" (UID: \"8eccaf406c63ad056385422d786042ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal" Jul 16 22:13:54.744678 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.744667 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8eccaf406c63ad056385422d786042ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal\" (UID: \"8eccaf406c63ad056385422d786042ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal" Jul 16 22:13:54.744748 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.744691 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8eccaf406c63ad056385422d786042ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal\" (UID: \"8eccaf406c63ad056385422d786042ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal" Jul 16 22:13:54.744748 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.744735 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8eccaf406c63ad056385422d786042ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal\" (UID: \"8eccaf406c63ad056385422d786042ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal" Jul 16 22:13:54.839990 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.839954 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-127.ec2.internal\" not found" Jul 16 22:13:54.851136 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.851113 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal" Jul 16 22:13:54.856247 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:54.856230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-127.ec2.internal" Jul 16 22:13:54.944011 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:54.943971 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-127.ec2.internal\" not found" Jul 16 22:13:55.044619 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:55.044556 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-127.ec2.internal\" not found" Jul 16 22:13:55.145234 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:55.145207 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-127.ec2.internal\" not found" Jul 16 22:13:55.182193 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:55.182176 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 22:13:55.182587 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:55.182329 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 22:13:55.182587 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:55.182354 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 22:13:55.246195 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:55.246165 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-127.ec2.internal\" not found" Jul 16 22:13:55.246195 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:55.246185 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 22:08:55 +0000 UTC" deadline="2028-03-28 17:29:39.780481942 +0000 UTC" Jul 16 22:13:55.246337 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:55.246216 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14899h15m44.534277127s" Jul 16 22:13:55.347023 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:55.346961 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-127.ec2.internal\" not found" Jul 16 22:13:55.448118 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:55.448084 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-127.ec2.internal\" not found" Jul 16 22:13:55.472043 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:55.472023 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 22:13:55.475324 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:55.475297 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eccaf406c63ad056385422d786042ee.slice/crio-e58c70f822af6594745fb2d8b2b11c7eed20be44bbe2b0f19c174cc6f0437cb4 WatchSource:0}: Error finding container e58c70f822af6594745fb2d8b2b11c7eed20be44bbe2b0f19c174cc6f0437cb4: Status 404 returned error can't find the container with id e58c70f822af6594745fb2d8b2b11c7eed20be44bbe2b0f19c174cc6f0437cb4 Jul 16 22:13:55.475559 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:55.475540 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfecc055662ef0ce2b1d85dad656ceb0.slice/crio-7804eb973ad6c63f85722b21d437e122fead4f07a0f635a749d60529c1868388 WatchSource:0}: Error finding container 7804eb973ad6c63f85722b21d437e122fead4f07a0f635a749d60529c1868388: Status 404 returned error can't find the container with id 7804eb973ad6c63f85722b21d437e122fead4f07a0f635a749d60529c1868388 Jul 16 22:13:55.480962 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:55.480943 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 22:13:55.542593 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:55.542553 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal" Jul 16 22:13:55.556278 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:55.556259 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 22:13:55.558314 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:55.558300 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-127.ec2.internal" Jul 16 22:13:55.568719 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:55.568696 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 22:13:55.614384 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:55.613880 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 22:13:56.221960 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.221911 2578 apiserver.go:52] "Watching apiserver" Jul 16 22:13:56.232330 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.232300 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 22:13:56.233067 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.233037 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-127.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx","openshift-cluster-node-tuning-operator/tuned-r5bxj","openshift-image-registry/node-ca-48dtb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal","openshift-multus/multus-additional-cni-plugins-2b2s7","openshift-multus/multus-mxsxh","kube-system/global-pull-secret-syncer-5kh2w","openshift-dns/node-resolver-sktxq","openshift-multus/network-metrics-daemon-lfgnf","openshift-network-diagnostics/network-check-target-qw5dv","openshift-network-operator/iptables-alerter-wx25f","openshift-ovn-kubernetes/ovnkube-node-kxm9g","kube-system/konnectivity-agent-xvjcl"] Jul 16 22:13:56.234750 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.234726 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.236804 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.236744 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:13:56.236912 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:56.236821 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qw5dv" podUID="62bd794a-17be-4c5f-8140-dde7861a983b" Jul 16 22:13:56.238671 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.237844 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 22:13:56.238671 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.238092 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xmdp5\"" Jul 16 22:13:56.238671 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.238105 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 22:13:56.238671 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.238306 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 22:13:56.238671 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.238520 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 22:13:56.238671 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.238543 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.243126 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.240924 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-48dtb" Jul 16 22:13:56.243126 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.241532 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-snqzb\"" Jul 16 22:13:56.243126 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.241797 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 22:13:56.243126 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.242045 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 22:13:56.243126 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.242318 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xvjcl" Jul 16 22:13:56.243126 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.242352 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 22:13:56.243126 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.242759 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.243945 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.243599 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sktxq" Jul 16 22:13:56.245174 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.245138 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.245609 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.245587 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 22:13:56.245848 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.245647 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 22:13:56.246070 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.246051 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 22:13:56.246170 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.246058 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5jmd6\"" Jul 16 22:13:56.246170 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.246123 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rlxgn\"" Jul 16 22:13:56.247279 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.246645 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.247279 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.247085 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-25dc4\"" Jul 16 22:13:56.247707 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.247423 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 22:13:56.247707 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.247440 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 22:13:56.247707 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.247567 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 22:13:56.247707 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.247688 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 22:13:56.247707 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.247705 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cwl7z\"" Jul 16 22:13:56.247970 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.247809 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 22:13:56.247970 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.247827 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 22:13:56.248082 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.248019 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:13:56.248168 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.248118 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 22:13:56.248168 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:56.248134 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfgnf" podUID="e9988a04-8333-4c15-91b9-bf93b1d1bdd9" Jul 16 22:13:56.248168 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.248156 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 22:13:56.250790 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.249765 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 22:13:56.250790 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.249787 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wkd68\"" Jul 16 22:13:56.250790 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.249859 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 22:13:56.250790 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.249791 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 22:13:56.250790 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.250035 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 22:13:56.250790 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.250044 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:13:56.250790 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:56.250126 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kh2w" podUID="6af5cc45-24ab-41f7-93b0-2f257139bed2" Jul 16 22:13:56.250790 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.250620 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 22:13:56.250790 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.250710 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mvgh7\"" Jul 16 22:13:56.251368 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.250900 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wx25f" Jul 16 22:13:56.251549 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.251510 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 22:13:56.251641 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.251571 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 22:13:56.253468 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.253448 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 22:13:56.255875 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.255851 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 22:13:56.256255 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.256236 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 22:13:56.256371 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.256313 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-host-run-k8s-cni-cncf-io\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.256433 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.256386 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-multus-conf-dir\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.256497 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.256434 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-host-run-multus-certs\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.256497 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.256467 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-cni-binary-copy\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.256662 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.256644 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-etc-modprobe-d\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.256736 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.256682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-etc-sysctl-d\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.256736 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.256708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-system-cni-dir\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.256877 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.256741 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-os-release\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.256943 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.256883 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-host-var-lib-cni-multus\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.256943 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.256916 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-multus-daemon-config\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.256943 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.256922 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dpdxv\"" Jul 16 22:13:56.257095 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.256967 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-etc-kubernetes\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.257095 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257013 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrszs\" (UniqueName: \"kubernetes.io/projected/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-kube-api-access-rrszs\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.257095 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257050 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dd027fde-bcff-4cc5-a46c-37f4b1ec09b8-konnectivity-ca\") pod \"konnectivity-agent-xvjcl\" (UID: \"dd027fde-bcff-4cc5-a46c-37f4b1ec09b8\") " pod="kube-system/konnectivity-agent-xvjcl" Jul 16 22:13:56.257281 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-system-cni-dir\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.257281 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257171 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-cnibin\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.257281 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257204 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dd027fde-bcff-4cc5-a46c-37f4b1ec09b8-agent-certs\") pod \"konnectivity-agent-xvjcl\" (UID: \"dd027fde-bcff-4cc5-a46c-37f4b1ec09b8\") " pod="kube-system/konnectivity-agent-xvjcl" Jul 16 22:13:56.257281 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257238 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-os-release\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.257281 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257266 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.257536 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257297 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79fde428-77a9-46c5-8239-73be6e3df2c8-tmp-dir\") pod \"node-resolver-sktxq\" (UID: \"79fde428-77a9-46c5-8239-73be6e3df2c8\") " pod="openshift-dns/node-resolver-sktxq" Jul 16 22:13:56.257536 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqlvk\" (UniqueName: \"kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk\") pod \"network-check-target-qw5dv\" (UID: \"62bd794a-17be-4c5f-8140-dde7861a983b\") " pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:13:56.257536 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257397 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-host-run-netns\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.257536 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwfz6\" (UniqueName: \"kubernetes.io/projected/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-kube-api-access-cwfz6\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.257536 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257458 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/79fde428-77a9-46c5-8239-73be6e3df2c8-hosts-file\") pod \"node-resolver-sktxq\" (UID: \"79fde428-77a9-46c5-8239-73be6e3df2c8\") " pod="openshift-dns/node-resolver-sktxq" Jul 16 22:13:56.257536 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-etc-kubernetes\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.257536 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257514 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/974f32d3-1143-407b-9678-e911920634e4-etc-tuned\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.257908 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257540 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/974f32d3-1143-407b-9678-e911920634e4-tmp\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.257908 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257567 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-hostroot\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.257908 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257598 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72cgk\" (UniqueName: \"kubernetes.io/projected/d01020ff-0f0b-4e2a-b9a3-921a789917f6-kube-api-access-72cgk\") pod \"node-ca-48dtb\" (UID: \"d01020ff-0f0b-4e2a-b9a3-921a789917f6\") " pod="openshift-image-registry/node-ca-48dtb" Jul 16 22:13:56.257908 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257624 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.257908 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257656 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.257908 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257688 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-run\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.257908 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257728 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-lib-modules\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.257908 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257802 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-host-var-lib-cni-bin\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.257908 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257854 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4rw2\" (UniqueName: \"kubernetes.io/projected/79fde428-77a9-46c5-8239-73be6e3df2c8-kube-api-access-f4rw2\") pod \"node-resolver-sktxq\" (UID: \"79fde428-77a9-46c5-8239-73be6e3df2c8\") " pod="openshift-dns/node-resolver-sktxq" Jul 16 22:13:56.257908 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257898 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-etc-sysconfig\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.258466 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257931 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-sys\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.258466 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.257975 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-host\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.258466 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.258002 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-multus-cni-dir\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.258466 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.258042 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-multus-socket-dir-parent\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.258466 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.258074 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-host-var-lib-kubelet\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.258466 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.258124 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 22:13:56.258466 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.258210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d01020ff-0f0b-4e2a-b9a3-921a789917f6-host\") pod \"node-ca-48dtb\" (UID: \"d01020ff-0f0b-4e2a-b9a3-921a789917f6\") " pod="openshift-image-registry/node-ca-48dtb" Jul 16 22:13:56.258466 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.258239 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d01020ff-0f0b-4e2a-b9a3-921a789917f6-serviceca\") pod \"node-ca-48dtb\" (UID: \"d01020ff-0f0b-4e2a-b9a3-921a789917f6\") " pod="openshift-image-registry/node-ca-48dtb" Jul 16 22:13:56.258466 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.258271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-cnibin\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.258466 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.258302 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-var-lib-kubelet\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.258466 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.258331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz8rb\" (UniqueName: \"kubernetes.io/projected/974f32d3-1143-407b-9678-e911920634e4-kube-api-access-nz8rb\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.258466 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.258364 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-etc-sysctl-conf\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.258466 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.258401 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-etc-systemd\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.259121 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.258770 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-cni-binary-copy\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.281842 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.281817 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f8dnt" Jul 16 22:13:56.290885 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.290865 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f8dnt" Jul 16 22:13:56.343558 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.343533 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 22:13:56.359900 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-multus-cni-dir\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.359900 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359244 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-host-var-lib-kubelet\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.359900 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359272 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d01020ff-0f0b-4e2a-b9a3-921a789917f6-host\") pod \"node-ca-48dtb\" (UID: \"d01020ff-0f0b-4e2a-b9a3-921a789917f6\") " pod="openshift-image-registry/node-ca-48dtb" Jul 16 22:13:56.359900 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359296 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d01020ff-0f0b-4e2a-b9a3-921a789917f6-serviceca\") pod \"node-ca-48dtb\" (UID: \"d01020ff-0f0b-4e2a-b9a3-921a789917f6\") " pod="openshift-image-registry/node-ca-48dtb" Jul 16 22:13:56.359900 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-cnibin\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.359900 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359344 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-var-lib-kubelet\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.359900 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359369 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz8rb\" (UniqueName: \"kubernetes.io/projected/974f32d3-1143-407b-9678-e911920634e4-kube-api-access-nz8rb\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.359900 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359399 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-slash\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.359900 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359434 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-etc-systemd\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.359900 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359460 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-kubelet\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.359900 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359501 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-run-systemd\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.359900 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359524 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-node-log\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.359900 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359523 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-multus-cni-dir\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.359900 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359548 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/599d5e9b-73a5-426a-8343-d8084d70d101-socket-dir\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.359900 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmbgh\" (UniqueName: \"kubernetes.io/projected/599d5e9b-73a5-426a-8343-d8084d70d101-kube-api-access-mmbgh\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.359900 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359609 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/875bc679-2c82-428c-bef6-022a70b53063-iptables-alerter-script\") pod \"iptables-alerter-wx25f\" (UID: \"875bc679-2c82-428c-bef6-022a70b53063\") " pod="openshift-network-operator/iptables-alerter-wx25f" Jul 16 22:13:56.359900 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359654 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-cni-binary-copy\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.360946 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359683 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-cnibin\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.360946 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359693 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-host-run-multus-certs\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.360946 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359744 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-host-run-multus-certs\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.360946 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-cni-binary-copy\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.360946 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359798 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-etc-modprobe-d\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.360946 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359826 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-etc-sysctl-d\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.360946 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359857 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-var-lib-kubelet\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.360946 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359860 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-etc-openvswitch\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.360946 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.359919 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-cni-netd\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.360946 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360020 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-etc-systemd\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.360946 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360085 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d01020ff-0f0b-4e2a-b9a3-921a789917f6-serviceca\") pod \"node-ca-48dtb\" (UID: \"d01020ff-0f0b-4e2a-b9a3-921a789917f6\") " pod="openshift-image-registry/node-ca-48dtb" Jul 16 22:13:56.360946 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360148 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/599d5e9b-73a5-426a-8343-d8084d70d101-etc-selinux\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.360946 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360223 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-etc-modprobe-d\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.360946 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360236 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-etc-sysctl-d\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.360946 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360183 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-host-var-lib-kubelet\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.360946 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360225 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-os-release\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.360946 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-host-var-lib-cni-multus\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.361793 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360331 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrszs\" (UniqueName: \"kubernetes.io/projected/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-kube-api-access-rrszs\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.361793 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360317 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-os-release\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.361793 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dd027fde-bcff-4cc5-a46c-37f4b1ec09b8-konnectivity-ca\") pod \"konnectivity-agent-xvjcl\" (UID: \"dd027fde-bcff-4cc5-a46c-37f4b1ec09b8\") " pod="kube-system/konnectivity-agent-xvjcl" Jul 16 22:13:56.361793 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360413 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79fde428-77a9-46c5-8239-73be6e3df2c8-tmp-dir\") pod \"node-resolver-sktxq\" (UID: \"79fde428-77a9-46c5-8239-73be6e3df2c8\") " pod="openshift-dns/node-resolver-sktxq" Jul 16 22:13:56.361793 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360444 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.361793 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360411 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-host-var-lib-cni-multus\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.361793 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360534 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ed956afc-2bf8-4635-99b2-75bbb6ee3974-ovnkube-script-lib\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.361793 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360536 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-cni-binary-copy\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.361793 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-cnibin\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.361793 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360618 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dd027fde-bcff-4cc5-a46c-37f4b1ec09b8-agent-certs\") pod \"konnectivity-agent-xvjcl\" (UID: \"dd027fde-bcff-4cc5-a46c-37f4b1ec09b8\") " pod="kube-system/konnectivity-agent-xvjcl" Jul 16 22:13:56.361793 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360626 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-cnibin\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.361793 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360621 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d01020ff-0f0b-4e2a-b9a3-921a789917f6-host\") pod \"node-ca-48dtb\" (UID: \"d01020ff-0f0b-4e2a-b9a3-921a789917f6\") " pod="openshift-image-registry/node-ca-48dtb" Jul 16 22:13:56.361793 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360657 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-os-release\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.361793 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360783 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.361793 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360815 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-os-release\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.361793 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360844 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-cni-binary-copy\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.361793 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360866 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79fde428-77a9-46c5-8239-73be6e3df2c8-tmp-dir\") pod \"node-resolver-sktxq\" (UID: \"79fde428-77a9-46c5-8239-73be6e3df2c8\") " pod="openshift-dns/node-resolver-sktxq" Jul 16 22:13:56.361793 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360871 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/974f32d3-1143-407b-9678-e911920634e4-etc-tuned\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.362637 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360962 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/974f32d3-1143-407b-9678-e911920634e4-tmp\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.362637 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360998 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-run-openvswitch\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.362637 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.360994 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 22:13:56.362637 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-host-run-netns\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.362637 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwfz6\" (UniqueName: \"kubernetes.io/projected/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-kube-api-access-cwfz6\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.362637 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361159 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6af5cc45-24ab-41f7-93b0-2f257139bed2-dbus\") pod \"global-pull-secret-syncer-5kh2w\" (UID: \"6af5cc45-24ab-41f7-93b0-2f257139bed2\") " pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:13:56.362637 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/875bc679-2c82-428c-bef6-022a70b53063-host-slash\") pod \"iptables-alerter-wx25f\" (UID: \"875bc679-2c82-428c-bef6-022a70b53063\") " pod="openshift-network-operator/iptables-alerter-wx25f" Jul 16 22:13:56.362637 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361229 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-hostroot\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.362637 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361261 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72cgk\" (UniqueName: \"kubernetes.io/projected/d01020ff-0f0b-4e2a-b9a3-921a789917f6-kube-api-access-72cgk\") pod \"node-ca-48dtb\" (UID: \"d01020ff-0f0b-4e2a-b9a3-921a789917f6\") " pod="openshift-image-registry/node-ca-48dtb" Jul 16 22:13:56.362637 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361260 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dd027fde-bcff-4cc5-a46c-37f4b1ec09b8-konnectivity-ca\") pod \"konnectivity-agent-xvjcl\" (UID: \"dd027fde-bcff-4cc5-a46c-37f4b1ec09b8\") " pod="kube-system/konnectivity-agent-xvjcl" Jul 16 22:13:56.362637 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361289 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.362637 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361346 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-host-run-netns\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.362637 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361372 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.362637 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361426 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-sys\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.362637 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361450 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-host\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.362637 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361474 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-multus-socket-dir-parent\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.362637 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361500 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/599d5e9b-73a5-426a-8343-d8084d70d101-device-dir\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.363494 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-etc-sysctl-conf\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.363494 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdn95\" (UniqueName: \"kubernetes.io/projected/875bc679-2c82-428c-bef6-022a70b53063-kube-api-access-qdn95\") pod \"iptables-alerter-wx25f\" (UID: \"875bc679-2c82-428c-bef6-022a70b53063\") " pod="openshift-network-operator/iptables-alerter-wx25f" Jul 16 22:13:56.363494 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-host-run-k8s-cni-cncf-io\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.363494 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-multus-conf-dir\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.363494 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361639 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-run-ovn\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.363494 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-log-socket\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.363494 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361681 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-cni-bin\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.363494 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361734 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ed956afc-2bf8-4635-99b2-75bbb6ee3974-ovnkube-config\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.363494 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361757 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs\") pod \"network-metrics-daemon-lfgnf\" (UID: \"e9988a04-8333-4c15-91b9-bf93b1d1bdd9\") " pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:13:56.363494 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361762 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.363494 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361782 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-run\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.363494 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361772 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-multus-socket-dir-parent\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.363494 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-lib-modules\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.363494 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361816 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-hostroot\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.363494 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361836 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-system-cni-dir\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.363494 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361844 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-sys\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.363494 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361863 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-host\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.364341 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-multus-daemon-config\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.364341 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361931 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-etc-kubernetes\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.364341 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361935 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-host-run-k8s-cni-cncf-io\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.364341 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/599d5e9b-73a5-426a-8343-d8084d70d101-registration-dir\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.364341 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361971 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-multus-conf-dir\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.364341 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361972 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-etc-sysctl-conf\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.364341 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.361981 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/599d5e9b-73a5-426a-8343-d8084d70d101-sys-fs\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.364341 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-system-cni-dir\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.364341 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362013 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-system-cni-dir\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.364341 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362031 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqlvk\" (UniqueName: \"kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk\") pod \"network-check-target-qw5dv\" (UID: \"62bd794a-17be-4c5f-8140-dde7861a983b\") " pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:13:56.364341 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-etc-kubernetes\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.364341 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362084 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-systemd-units\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.364341 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362098 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-etc-kubernetes\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.364341 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362142 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-system-cni-dir\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.364341 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ed956afc-2bf8-4635-99b2-75bbb6ee3974-env-overrides\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.364341 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362217 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed956afc-2bf8-4635-99b2-75bbb6ee3974-ovn-node-metrics-cert\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.364341 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362239 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h862\" (UniqueName: \"kubernetes.io/projected/ed956afc-2bf8-4635-99b2-75bbb6ee3974-kube-api-access-7h862\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.365236 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362266 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/79fde428-77a9-46c5-8239-73be6e3df2c8-hosts-file\") pod \"node-resolver-sktxq\" (UID: \"79fde428-77a9-46c5-8239-73be6e3df2c8\") " pod="openshift-dns/node-resolver-sktxq" Jul 16 22:13:56.365236 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362326 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-run-netns\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.365236 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362354 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsnpv\" (UniqueName: \"kubernetes.io/projected/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-kube-api-access-lsnpv\") pod \"network-metrics-daemon-lfgnf\" (UID: \"e9988a04-8333-4c15-91b9-bf93b1d1bdd9\") " pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:13:56.365236 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362372 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/79fde428-77a9-46c5-8239-73be6e3df2c8-hosts-file\") pod \"node-resolver-sktxq\" (UID: \"79fde428-77a9-46c5-8239-73be6e3df2c8\") " pod="openshift-dns/node-resolver-sktxq" Jul 16 22:13:56.365236 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362391 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.365236 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362416 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-var-lib-openvswitch\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.365236 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362433 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-etc-kubernetes\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.365236 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-run-ovn-kubernetes\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.365236 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362543 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-lib-modules\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.365236 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362559 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-multus-daemon-config\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.365236 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362589 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.365236 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/599d5e9b-73a5-426a-8343-d8084d70d101-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.365236 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362615 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-run\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.365236 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362658 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret\") pod \"global-pull-secret-syncer-5kh2w\" (UID: \"6af5cc45-24ab-41f7-93b0-2f257139bed2\") " pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:13:56.365236 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-host-var-lib-cni-bin\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.365236 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4rw2\" (UniqueName: \"kubernetes.io/projected/79fde428-77a9-46c5-8239-73be6e3df2c8-kube-api-access-f4rw2\") pod \"node-resolver-sktxq\" (UID: \"79fde428-77a9-46c5-8239-73be6e3df2c8\") " pod="openshift-dns/node-resolver-sktxq" Jul 16 22:13:56.365236 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362763 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-etc-sysconfig\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.366401 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6af5cc45-24ab-41f7-93b0-2f257139bed2-kubelet-config\") pod \"global-pull-secret-syncer-5kh2w\" (UID: \"6af5cc45-24ab-41f7-93b0-2f257139bed2\") " pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:13:56.366401 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362811 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/974f32d3-1143-407b-9678-e911920634e4-etc-sysconfig\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.366401 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.362941 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-host-var-lib-cni-bin\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.366401 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.365247 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/974f32d3-1143-407b-9678-e911920634e4-tmp\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.366401 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.365493 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dd027fde-bcff-4cc5-a46c-37f4b1ec09b8-agent-certs\") pod \"konnectivity-agent-xvjcl\" (UID: \"dd027fde-bcff-4cc5-a46c-37f4b1ec09b8\") " pod="kube-system/konnectivity-agent-xvjcl" Jul 16 22:13:56.366401 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.365719 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 22:13:56.366401 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.366222 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/974f32d3-1143-407b-9678-e911920634e4-etc-tuned\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.368293 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:56.368274 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 22:13:56.368819 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:56.368297 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 22:13:56.368819 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:56.368311 2578 projected.go:196] Error preparing data for projected volume kube-api-access-nqlvk for pod openshift-network-diagnostics/network-check-target-qw5dv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 22:13:56.368819 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:56.368412 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk podName:62bd794a-17be-4c5f-8140-dde7861a983b nodeName:}" failed. No retries permitted until 2026-07-16 22:13:56.86839452 +0000 UTC m=+2.971039749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nqlvk" (UniqueName: "kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk") pod "network-check-target-qw5dv" (UID: "62bd794a-17be-4c5f-8140-dde7861a983b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 22:13:56.370965 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.370940 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz8rb\" (UniqueName: \"kubernetes.io/projected/974f32d3-1143-407b-9678-e911920634e4-kube-api-access-nz8rb\") pod \"tuned-r5bxj\" (UID: \"974f32d3-1143-407b-9678-e911920634e4\") " pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.371991 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.371956 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwfz6\" (UniqueName: \"kubernetes.io/projected/a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec-kube-api-access-cwfz6\") pod \"multus-additional-cni-plugins-2b2s7\" (UID: \"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec\") " pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.372754 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.372719 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4rw2\" (UniqueName: \"kubernetes.io/projected/79fde428-77a9-46c5-8239-73be6e3df2c8-kube-api-access-f4rw2\") pod \"node-resolver-sktxq\" (UID: \"79fde428-77a9-46c5-8239-73be6e3df2c8\") " pod="openshift-dns/node-resolver-sktxq" Jul 16 22:13:56.373209 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.373190 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72cgk\" (UniqueName: \"kubernetes.io/projected/d01020ff-0f0b-4e2a-b9a3-921a789917f6-kube-api-access-72cgk\") pod \"node-ca-48dtb\" (UID: \"d01020ff-0f0b-4e2a-b9a3-921a789917f6\") " pod="openshift-image-registry/node-ca-48dtb" Jul 16 22:13:56.374283 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.374260 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrszs\" (UniqueName: \"kubernetes.io/projected/2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f-kube-api-access-rrszs\") pod \"multus-mxsxh\" (UID: \"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f\") " pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.430626 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.430564 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-127.ec2.internal" event={"ID":"bfecc055662ef0ce2b1d85dad656ceb0","Type":"ContainerStarted","Data":"7804eb973ad6c63f85722b21d437e122fead4f07a0f635a749d60529c1868388"} Jul 16 22:13:56.432317 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.432254 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal" event={"ID":"8eccaf406c63ad056385422d786042ee","Type":"ContainerStarted","Data":"e58c70f822af6594745fb2d8b2b11c7eed20be44bbe2b0f19c174cc6f0437cb4"} Jul 16 22:13:56.464124 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-slash\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.464250 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-kubelet\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.464250 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-run-systemd\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.464250 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-node-log\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.464250 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464202 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/599d5e9b-73a5-426a-8343-d8084d70d101-socket-dir\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.464250 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmbgh\" (UniqueName: \"kubernetes.io/projected/599d5e9b-73a5-426a-8343-d8084d70d101-kube-api-access-mmbgh\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.464250 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464225 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-slash\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.464250 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464249 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/875bc679-2c82-428c-bef6-022a70b53063-iptables-alerter-script\") pod \"iptables-alerter-wx25f\" (UID: \"875bc679-2c82-428c-bef6-022a70b53063\") " pod="openshift-network-operator/iptables-alerter-wx25f" Jul 16 22:13:56.464607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464280 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-etc-openvswitch\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.464607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464292 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-node-log\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.464607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-cni-netd\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.464607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464330 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/599d5e9b-73a5-426a-8343-d8084d70d101-etc-selinux\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.464607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464334 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-kubelet\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.464607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.464607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464377 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-run-systemd\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.464607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464388 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ed956afc-2bf8-4635-99b2-75bbb6ee3974-ovnkube-script-lib\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.464607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464419 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-etc-openvswitch\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.464607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464420 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-run-openvswitch\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.464607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6af5cc45-24ab-41f7-93b0-2f257139bed2-dbus\") pod \"global-pull-secret-syncer-5kh2w\" (UID: \"6af5cc45-24ab-41f7-93b0-2f257139bed2\") " pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:13:56.464607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464464 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-run-openvswitch\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.464607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/875bc679-2c82-428c-bef6-022a70b53063-host-slash\") pod \"iptables-alerter-wx25f\" (UID: \"875bc679-2c82-428c-bef6-022a70b53063\") " pod="openshift-network-operator/iptables-alerter-wx25f" Jul 16 22:13:56.464607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464526 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/599d5e9b-73a5-426a-8343-d8084d70d101-device-dir\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.464607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464531 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-cni-netd\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.464607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464544 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdn95\" (UniqueName: \"kubernetes.io/projected/875bc679-2c82-428c-bef6-022a70b53063-kube-api-access-qdn95\") pod \"iptables-alerter-wx25f\" (UID: \"875bc679-2c82-428c-bef6-022a70b53063\") " pod="openshift-network-operator/iptables-alerter-wx25f" Jul 16 22:13:56.464607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464563 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-run-ovn\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.465464 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464585 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-log-socket\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.465464 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464610 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-cni-bin\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.465464 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464634 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ed956afc-2bf8-4635-99b2-75bbb6ee3974-ovnkube-config\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.465464 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464647 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/599d5e9b-73a5-426a-8343-d8084d70d101-etc-selinux\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.465464 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs\") pod \"network-metrics-daemon-lfgnf\" (UID: \"e9988a04-8333-4c15-91b9-bf93b1d1bdd9\") " pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:13:56.465464 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/599d5e9b-73a5-426a-8343-d8084d70d101-registration-dir\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.465464 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464691 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.465464 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464719 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/599d5e9b-73a5-426a-8343-d8084d70d101-sys-fs\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.465464 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464763 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-systemd-units\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.465464 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464790 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ed956afc-2bf8-4635-99b2-75bbb6ee3974-env-overrides\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.465464 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464815 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed956afc-2bf8-4635-99b2-75bbb6ee3974-ovn-node-metrics-cert\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.465464 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464841 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h862\" (UniqueName: \"kubernetes.io/projected/ed956afc-2bf8-4635-99b2-75bbb6ee3974-kube-api-access-7h862\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.465464 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464866 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-run-netns\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.465464 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsnpv\" (UniqueName: \"kubernetes.io/projected/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-kube-api-access-lsnpv\") pod \"network-metrics-daemon-lfgnf\" (UID: \"e9988a04-8333-4c15-91b9-bf93b1d1bdd9\") " pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:13:56.465464 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-var-lib-openvswitch\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.465464 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464938 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-run-ovn-kubernetes\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.465464 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/599d5e9b-73a5-426a-8343-d8084d70d101-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.466393 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret\") pod \"global-pull-secret-syncer-5kh2w\" (UID: \"6af5cc45-24ab-41f7-93b0-2f257139bed2\") " pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:13:56.466393 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.464994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6af5cc45-24ab-41f7-93b0-2f257139bed2-kubelet-config\") pod \"global-pull-secret-syncer-5kh2w\" (UID: \"6af5cc45-24ab-41f7-93b0-2f257139bed2\") " pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:13:56.466393 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.465061 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6af5cc45-24ab-41f7-93b0-2f257139bed2-kubelet-config\") pod \"global-pull-secret-syncer-5kh2w\" (UID: \"6af5cc45-24ab-41f7-93b0-2f257139bed2\") " pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:13:56.466393 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.465097 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/599d5e9b-73a5-426a-8343-d8084d70d101-registration-dir\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.466393 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.465132 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/599d5e9b-73a5-426a-8343-d8084d70d101-sys-fs\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.466393 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:56.465133 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 22:13:56.466393 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.465186 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-systemd-units\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.466393 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:56.465218 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs podName:e9988a04-8333-4c15-91b9-bf93b1d1bdd9 nodeName:}" failed. No retries permitted until 2026-07-16 22:13:56.965198711 +0000 UTC m=+3.067843917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs") pod "network-metrics-daemon-lfgnf" (UID: "e9988a04-8333-4c15-91b9-bf93b1d1bdd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 22:13:56.466393 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.465257 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-run-netns\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.466393 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.465260 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/599d5e9b-73a5-426a-8343-d8084d70d101-device-dir\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.466393 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.465365 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ed956afc-2bf8-4635-99b2-75bbb6ee3974-ovnkube-script-lib\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.466393 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.465384 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-var-lib-openvswitch\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.466393 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.465440 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-run-ovn-kubernetes\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.466393 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.465452 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/599d5e9b-73a5-426a-8343-d8084d70d101-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.466393 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:56.465515 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 22:13:56.466393 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:56.465562 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret podName:6af5cc45-24ab-41f7-93b0-2f257139bed2 nodeName:}" failed. No retries permitted until 2026-07-16 22:13:56.965545801 +0000 UTC m=+3.068191017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret") pod "global-pull-secret-syncer-5kh2w" (UID: "6af5cc45-24ab-41f7-93b0-2f257139bed2") : object "kube-system"/"original-pull-secret" not registered Jul 16 22:13:56.467217 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.465704 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ed956afc-2bf8-4635-99b2-75bbb6ee3974-env-overrides\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.467217 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.465779 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6af5cc45-24ab-41f7-93b0-2f257139bed2-dbus\") pod \"global-pull-secret-syncer-5kh2w\" (UID: \"6af5cc45-24ab-41f7-93b0-2f257139bed2\") " pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:13:56.467217 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.465822 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/875bc679-2c82-428c-bef6-022a70b53063-host-slash\") pod \"iptables-alerter-wx25f\" (UID: \"875bc679-2c82-428c-bef6-022a70b53063\") " pod="openshift-network-operator/iptables-alerter-wx25f" Jul 16 22:13:56.467217 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.465865 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-log-socket\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.467217 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.465925 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ed956afc-2bf8-4635-99b2-75bbb6ee3974-ovnkube-config\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.467217 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.465964 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/599d5e9b-73a5-426a-8343-d8084d70d101-socket-dir\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.467217 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.465983 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-run-ovn\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.467217 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.466006 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/875bc679-2c82-428c-bef6-022a70b53063-iptables-alerter-script\") pod \"iptables-alerter-wx25f\" (UID: \"875bc679-2c82-428c-bef6-022a70b53063\") " pod="openshift-network-operator/iptables-alerter-wx25f" Jul 16 22:13:56.467217 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.466028 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed956afc-2bf8-4635-99b2-75bbb6ee3974-host-cni-bin\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.468579 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.468527 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed956afc-2bf8-4635-99b2-75bbb6ee3974-ovn-node-metrics-cert\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.478824 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.478763 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdn95\" (UniqueName: \"kubernetes.io/projected/875bc679-2c82-428c-bef6-022a70b53063-kube-api-access-qdn95\") pod \"iptables-alerter-wx25f\" (UID: \"875bc679-2c82-428c-bef6-022a70b53063\") " pod="openshift-network-operator/iptables-alerter-wx25f" Jul 16 22:13:56.479808 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.479759 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmbgh\" (UniqueName: \"kubernetes.io/projected/599d5e9b-73a5-426a-8343-d8084d70d101-kube-api-access-mmbgh\") pod \"aws-ebs-csi-driver-node-j6swx\" (UID: \"599d5e9b-73a5-426a-8343-d8084d70d101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.480961 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.480914 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsnpv\" (UniqueName: \"kubernetes.io/projected/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-kube-api-access-lsnpv\") pod \"network-metrics-daemon-lfgnf\" (UID: \"e9988a04-8333-4c15-91b9-bf93b1d1bdd9\") " pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:13:56.481829 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.481801 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h862\" (UniqueName: \"kubernetes.io/projected/ed956afc-2bf8-4635-99b2-75bbb6ee3974-kube-api-access-7h862\") pod \"ovnkube-node-kxm9g\" (UID: \"ed956afc-2bf8-4635-99b2-75bbb6ee3974\") " pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.552137 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.552106 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mxsxh" Jul 16 22:13:56.564796 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.564762 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" Jul 16 22:13:56.574703 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.574673 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-48dtb" Jul 16 22:13:56.581567 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.581546 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xvjcl" Jul 16 22:13:56.592521 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.592498 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2b2s7" Jul 16 22:13:56.597391 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.597371 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sktxq" Jul 16 22:13:56.608682 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.608645 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:13:56.616933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.616911 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" Jul 16 22:13:56.625105 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.625081 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wx25f" Jul 16 22:13:56.712962 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.712928 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 22:13:56.968192 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.968153 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs\") pod \"network-metrics-daemon-lfgnf\" (UID: \"e9988a04-8333-4c15-91b9-bf93b1d1bdd9\") " pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:13:56.968396 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.968201 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqlvk\" (UniqueName: \"kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk\") pod \"network-check-target-qw5dv\" (UID: \"62bd794a-17be-4c5f-8140-dde7861a983b\") " pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:13:56.968396 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:56.968246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret\") pod \"global-pull-secret-syncer-5kh2w\" (UID: \"6af5cc45-24ab-41f7-93b0-2f257139bed2\") " pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:13:56.968396 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:56.968337 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 22:13:56.968396 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:56.968388 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 22:13:56.968586 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:56.968407 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 22:13:56.968586 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:56.968425 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 22:13:56.968586 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:56.968428 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs podName:e9988a04-8333-4c15-91b9-bf93b1d1bdd9 nodeName:}" failed. No retries permitted until 2026-07-16 22:13:57.96840382 +0000 UTC m=+4.071049028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs") pod "network-metrics-daemon-lfgnf" (UID: "e9988a04-8333-4c15-91b9-bf93b1d1bdd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 22:13:56.968586 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:56.968438 2578 projected.go:196] Error preparing data for projected volume kube-api-access-nqlvk for pod openshift-network-diagnostics/network-check-target-qw5dv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 22:13:56.968586 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:56.968451 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret podName:6af5cc45-24ab-41f7-93b0-2f257139bed2 nodeName:}" failed. No retries permitted until 2026-07-16 22:13:57.96844022 +0000 UTC m=+4.071085429 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret") pod "global-pull-secret-syncer-5kh2w" (UID: "6af5cc45-24ab-41f7-93b0-2f257139bed2") : object "kube-system"/"original-pull-secret" not registered Jul 16 22:13:56.968586 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:56.968477 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk podName:62bd794a-17be-4c5f-8140-dde7861a983b nodeName:}" failed. No retries permitted until 2026-07-16 22:13:57.968465763 +0000 UTC m=+4.071110973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqlvk" (UniqueName: "kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk") pod "network-check-target-qw5dv" (UID: "62bd794a-17be-4c5f-8140-dde7861a983b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 22:13:57.293263 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:57.293180 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 22:08:57 +0000 UTC" deadline="2028-04-27 19:21:13.829052166 +0000 UTC" Jul 16 22:13:57.293263 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:57.293215 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15621h7m16.535841406s" Jul 16 22:13:57.425353 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:57.425323 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:13:57.425512 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:57.425481 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kh2w" podUID="6af5cc45-24ab-41f7-93b0-2f257139bed2" Jul 16 22:13:57.590880 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:57.590852 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79fde428_77a9_46c5_8239_73be6e3df2c8.slice/crio-61e440702bfe7ecbf7d952d08b5818bc6baf6628775762652a2660987be608a8 WatchSource:0}: Error finding container 61e440702bfe7ecbf7d952d08b5818bc6baf6628775762652a2660987be608a8: Status 404 returned error can't find the container with id 61e440702bfe7ecbf7d952d08b5818bc6baf6628775762652a2660987be608a8 Jul 16 22:13:57.595402 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:57.595372 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd01020ff_0f0b_4e2a_b9a3_921a789917f6.slice/crio-64c15a9383df214f589719094be8b57ce89f57b5ee0222bcd790e883001ed08b WatchSource:0}: Error finding container 64c15a9383df214f589719094be8b57ce89f57b5ee0222bcd790e883001ed08b: Status 404 returned error can't find the container with id 64c15a9383df214f589719094be8b57ce89f57b5ee0222bcd790e883001ed08b Jul 16 22:13:57.598466 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:57.598342 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60f0805_2fd1_4a0b_aa68_e6c7cfc2acec.slice/crio-67fbfb43a7d5c05cdc6bf5e01bfd1ccee8526b7a2125c3a6a67f284501984de6 WatchSource:0}: Error finding container 67fbfb43a7d5c05cdc6bf5e01bfd1ccee8526b7a2125c3a6a67f284501984de6: Status 404 returned error can't find the container with id 67fbfb43a7d5c05cdc6bf5e01bfd1ccee8526b7a2125c3a6a67f284501984de6 Jul 16 22:13:57.600442 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:57.600017 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod875bc679_2c82_428c_bef6_022a70b53063.slice/crio-da4d3005984107929d5cefd1435f5bd0f305bf3f1c6ebfd1e2dfd40fb58e9924 WatchSource:0}: Error finding container da4d3005984107929d5cefd1435f5bd0f305bf3f1c6ebfd1e2dfd40fb58e9924: Status 404 returned error can't find the container with id da4d3005984107929d5cefd1435f5bd0f305bf3f1c6ebfd1e2dfd40fb58e9924 Jul 16 22:13:57.604181 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:57.603830 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd027fde_bcff_4cc5_a46c_37f4b1ec09b8.slice/crio-411e18991114895b5bf9cc41e615c2e135397fcb60f075944723c919a2b61c88 WatchSource:0}: Error finding container 411e18991114895b5bf9cc41e615c2e135397fcb60f075944723c919a2b61c88: Status 404 returned error can't find the container with id 411e18991114895b5bf9cc41e615c2e135397fcb60f075944723c919a2b61c88 Jul 16 22:13:57.606107 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:57.606086 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded956afc_2bf8_4635_99b2_75bbb6ee3974.slice/crio-4028096b527cd8ef3f044e6964984f04a4189394187c0fad2025edf060a724c4 WatchSource:0}: Error finding container 4028096b527cd8ef3f044e6964984f04a4189394187c0fad2025edf060a724c4: Status 404 returned error can't find the container with id 4028096b527cd8ef3f044e6964984f04a4189394187c0fad2025edf060a724c4 Jul 16 22:13:57.607211 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:13:57.607136 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b3b0098_10a8_4c53_9ed3_d99dfebb5d3f.slice/crio-ca6b7daf9cc44db57b11ee2401d056ff85be3cfd02db60aa736c85faf0a678fa WatchSource:0}: Error finding container ca6b7daf9cc44db57b11ee2401d056ff85be3cfd02db60aa736c85faf0a678fa: Status 404 returned error can't find the container with id ca6b7daf9cc44db57b11ee2401d056ff85be3cfd02db60aa736c85faf0a678fa Jul 16 22:13:57.977363 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:57.977162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret\") pod \"global-pull-secret-syncer-5kh2w\" (UID: \"6af5cc45-24ab-41f7-93b0-2f257139bed2\") " pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:13:57.977496 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:57.977406 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs\") pod \"network-metrics-daemon-lfgnf\" (UID: \"e9988a04-8333-4c15-91b9-bf93b1d1bdd9\") " pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:13:57.977496 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:57.977325 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 22:13:57.977650 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:57.977507 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret podName:6af5cc45-24ab-41f7-93b0-2f257139bed2 nodeName:}" failed. No retries permitted until 2026-07-16 22:13:59.97748411 +0000 UTC m=+6.080129336 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret") pod "global-pull-secret-syncer-5kh2w" (UID: "6af5cc45-24ab-41f7-93b0-2f257139bed2") : object "kube-system"/"original-pull-secret" not registered Jul 16 22:13:57.977650 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:57.977526 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 22:13:57.977650 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:57.977430 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqlvk\" (UniqueName: \"kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk\") pod \"network-check-target-qw5dv\" (UID: \"62bd794a-17be-4c5f-8140-dde7861a983b\") " pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:13:57.977650 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:57.977548 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 22:13:57.977650 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:57.977570 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 22:13:57.977650 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:57.977584 2578 projected.go:196] Error preparing data for projected volume kube-api-access-nqlvk for pod openshift-network-diagnostics/network-check-target-qw5dv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 22:13:57.977650 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:57.977570 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs podName:e9988a04-8333-4c15-91b9-bf93b1d1bdd9 nodeName:}" failed. No retries permitted until 2026-07-16 22:13:59.977557721 +0000 UTC m=+6.080202934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs") pod "network-metrics-daemon-lfgnf" (UID: "e9988a04-8333-4c15-91b9-bf93b1d1bdd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 22:13:57.977650 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:57.977639 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk podName:62bd794a-17be-4c5f-8140-dde7861a983b nodeName:}" failed. No retries permitted until 2026-07-16 22:13:59.977626597 +0000 UTC m=+6.080271806 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqlvk" (UniqueName: "kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk") pod "network-check-target-qw5dv" (UID: "62bd794a-17be-4c5f-8140-dde7861a983b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 22:13:58.294342 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:58.294244 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 22:08:57 +0000 UTC" deadline="2028-03-26 14:39:31.312332192 +0000 UTC" Jul 16 22:13:58.294342 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:58.294310 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14848h25m33.01802658s" Jul 16 22:13:58.427691 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:58.427659 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:13:58.427880 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:58.427809 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfgnf" podUID="e9988a04-8333-4c15-91b9-bf93b1d1bdd9" Jul 16 22:13:58.428256 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:58.428235 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:13:58.428360 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:58.428338 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qw5dv" podUID="62bd794a-17be-4c5f-8140-dde7861a983b" Jul 16 22:13:58.453370 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:58.453337 2578 generic.go:356] "Generic (PLEG): container finished" podID="8eccaf406c63ad056385422d786042ee" containerID="d2586f084b676d5f7280fc23e53c3aa480ae1012dab2efeb1dd368b095582f51" exitCode=0 Jul 16 22:13:58.453523 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:58.453429 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal" event={"ID":"8eccaf406c63ad056385422d786042ee","Type":"ContainerDied","Data":"d2586f084b676d5f7280fc23e53c3aa480ae1012dab2efeb1dd368b095582f51"} Jul 16 22:13:58.458014 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:58.457986 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" event={"ID":"ed956afc-2bf8-4635-99b2-75bbb6ee3974","Type":"ContainerStarted","Data":"4028096b527cd8ef3f044e6964984f04a4189394187c0fad2025edf060a724c4"} Jul 16 22:13:58.464568 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:58.464510 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xvjcl" event={"ID":"dd027fde-bcff-4cc5-a46c-37f4b1ec09b8","Type":"ContainerStarted","Data":"411e18991114895b5bf9cc41e615c2e135397fcb60f075944723c919a2b61c88"} Jul 16 22:13:58.475899 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:58.475870 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mxsxh" event={"ID":"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f","Type":"ContainerStarted","Data":"ca6b7daf9cc44db57b11ee2401d056ff85be3cfd02db60aa736c85faf0a678fa"} Jul 16 22:13:58.494079 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:58.494044 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" event={"ID":"974f32d3-1143-407b-9678-e911920634e4","Type":"ContainerStarted","Data":"74f095b1cc3a581415125b10625af0aabf03223075a6f3491995435fd2fb59ca"} Jul 16 22:13:58.509368 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:58.509276 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-48dtb" event={"ID":"d01020ff-0f0b-4e2a-b9a3-921a789917f6","Type":"ContainerStarted","Data":"64c15a9383df214f589719094be8b57ce89f57b5ee0222bcd790e883001ed08b"} Jul 16 22:13:58.511503 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:58.511450 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sktxq" event={"ID":"79fde428-77a9-46c5-8239-73be6e3df2c8","Type":"ContainerStarted","Data":"61e440702bfe7ecbf7d952d08b5818bc6baf6628775762652a2660987be608a8"} Jul 16 22:13:58.527441 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:58.527387 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-127.ec2.internal" event={"ID":"bfecc055662ef0ce2b1d85dad656ceb0","Type":"ContainerStarted","Data":"0fe4ad8a4318275149b3e6923bf8d84c1f104949db4255e5fa4f7c9ec55761d7"} Jul 16 22:13:58.539545 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:58.539478 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" event={"ID":"599d5e9b-73a5-426a-8343-d8084d70d101","Type":"ContainerStarted","Data":"b68b25d95d580e99e2c08253975957f1c5750f73f9bdd7a09afe8084556cde2a"} Jul 16 22:13:58.554219 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:58.554142 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wx25f" event={"ID":"875bc679-2c82-428c-bef6-022a70b53063","Type":"ContainerStarted","Data":"da4d3005984107929d5cefd1435f5bd0f305bf3f1c6ebfd1e2dfd40fb58e9924"} Jul 16 22:13:58.570948 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:58.570909 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2b2s7" event={"ID":"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec","Type":"ContainerStarted","Data":"67fbfb43a7d5c05cdc6bf5e01bfd1ccee8526b7a2125c3a6a67f284501984de6"} Jul 16 22:13:59.425655 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:59.425278 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:13:59.425655 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:59.425424 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kh2w" podUID="6af5cc45-24ab-41f7-93b0-2f257139bed2" Jul 16 22:13:59.589481 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:59.589397 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal" event={"ID":"8eccaf406c63ad056385422d786042ee","Type":"ContainerStarted","Data":"e89bf3b7006d34fd320f92cc5d85675dffc057d566223458bd0b496d250ff11e"} Jul 16 22:13:59.609154 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:59.608790 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-127.ec2.internal" podStartSLOduration=3.608766587 podStartE2EDuration="3.608766587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:13:58.546208268 +0000 UTC m=+4.648853499" watchObservedRunningTime="2026-07-16 22:13:59.608766587 +0000 UTC m=+5.711411822" Jul 16 22:13:59.995360 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:59.995318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs\") pod \"network-metrics-daemon-lfgnf\" (UID: \"e9988a04-8333-4c15-91b9-bf93b1d1bdd9\") " pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:13:59.995563 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:59.995377 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqlvk\" (UniqueName: \"kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk\") pod \"network-check-target-qw5dv\" (UID: \"62bd794a-17be-4c5f-8140-dde7861a983b\") " pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:13:59.995563 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:13:59.995415 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret\") pod \"global-pull-secret-syncer-5kh2w\" (UID: \"6af5cc45-24ab-41f7-93b0-2f257139bed2\") " pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:13:59.995563 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:59.995557 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 22:13:59.995744 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:59.995627 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret podName:6af5cc45-24ab-41f7-93b0-2f257139bed2 nodeName:}" failed. No retries permitted until 2026-07-16 22:14:03.995605878 +0000 UTC m=+10.098251099 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret") pod "global-pull-secret-syncer-5kh2w" (UID: "6af5cc45-24ab-41f7-93b0-2f257139bed2") : object "kube-system"/"original-pull-secret" not registered Jul 16 22:13:59.996068 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:59.996044 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 22:13:59.996231 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:59.996111 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs podName:e9988a04-8333-4c15-91b9-bf93b1d1bdd9 nodeName:}" failed. No retries permitted until 2026-07-16 22:14:03.99609173 +0000 UTC m=+10.098736962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs") pod "network-metrics-daemon-lfgnf" (UID: "e9988a04-8333-4c15-91b9-bf93b1d1bdd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 22:13:59.996231 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:59.996219 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 22:13:59.996375 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:59.996236 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 22:13:59.996375 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:59.996249 2578 projected.go:196] Error preparing data for projected volume kube-api-access-nqlvk for pod openshift-network-diagnostics/network-check-target-qw5dv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 22:13:59.996375 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:13:59.996293 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk podName:62bd794a-17be-4c5f-8140-dde7861a983b nodeName:}" failed. No retries permitted until 2026-07-16 22:14:03.996280253 +0000 UTC m=+10.098925483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqlvk" (UniqueName: "kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk") pod "network-check-target-qw5dv" (UID: "62bd794a-17be-4c5f-8140-dde7861a983b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 22:14:00.426355 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:00.426260 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:14:00.426829 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:00.426413 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfgnf" podUID="e9988a04-8333-4c15-91b9-bf93b1d1bdd9" Jul 16 22:14:00.427005 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:00.426979 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:14:00.427210 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:00.427114 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qw5dv" podUID="62bd794a-17be-4c5f-8140-dde7861a983b" Jul 16 22:14:01.424652 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:01.424614 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:14:01.424860 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:01.424764 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kh2w" podUID="6af5cc45-24ab-41f7-93b0-2f257139bed2" Jul 16 22:14:02.425965 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:02.425303 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:14:02.425965 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:02.425457 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfgnf" podUID="e9988a04-8333-4c15-91b9-bf93b1d1bdd9" Jul 16 22:14:02.425965 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:02.425824 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:14:02.425965 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:02.425923 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qw5dv" podUID="62bd794a-17be-4c5f-8140-dde7861a983b" Jul 16 22:14:03.425758 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:03.425719 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:14:03.425988 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:03.425863 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kh2w" podUID="6af5cc45-24ab-41f7-93b0-2f257139bed2" Jul 16 22:14:04.031893 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:04.031472 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs\") pod \"network-metrics-daemon-lfgnf\" (UID: \"e9988a04-8333-4c15-91b9-bf93b1d1bdd9\") " pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:14:04.031893 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:04.031534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqlvk\" (UniqueName: \"kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk\") pod \"network-check-target-qw5dv\" (UID: \"62bd794a-17be-4c5f-8140-dde7861a983b\") " pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:14:04.031893 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:04.031573 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret\") pod \"global-pull-secret-syncer-5kh2w\" (UID: \"6af5cc45-24ab-41f7-93b0-2f257139bed2\") " pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:14:04.031893 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:04.031644 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 22:14:04.031893 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:04.031663 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 22:14:04.031893 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:04.031712 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret podName:6af5cc45-24ab-41f7-93b0-2f257139bed2 nodeName:}" failed. No retries permitted until 2026-07-16 22:14:12.031693249 +0000 UTC m=+18.134338454 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret") pod "global-pull-secret-syncer-5kh2w" (UID: "6af5cc45-24ab-41f7-93b0-2f257139bed2") : object "kube-system"/"original-pull-secret" not registered Jul 16 22:14:04.031893 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:04.031729 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs podName:e9988a04-8333-4c15-91b9-bf93b1d1bdd9 nodeName:}" failed. No retries permitted until 2026-07-16 22:14:12.031720404 +0000 UTC m=+18.134365610 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs") pod "network-metrics-daemon-lfgnf" (UID: "e9988a04-8333-4c15-91b9-bf93b1d1bdd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 22:14:04.031893 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:04.031802 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 22:14:04.031893 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:04.031816 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 22:14:04.031893 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:04.031828 2578 projected.go:196] Error preparing data for projected volume kube-api-access-nqlvk for pod openshift-network-diagnostics/network-check-target-qw5dv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 22:14:04.031893 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:04.031863 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk podName:62bd794a-17be-4c5f-8140-dde7861a983b nodeName:}" failed. No retries permitted until 2026-07-16 22:14:12.031851672 +0000 UTC m=+18.134496878 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqlvk" (UniqueName: "kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk") pod "network-check-target-qw5dv" (UID: "62bd794a-17be-4c5f-8140-dde7861a983b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 22:14:04.426055 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:04.425962 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:14:04.426538 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:04.426106 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfgnf" podUID="e9988a04-8333-4c15-91b9-bf93b1d1bdd9" Jul 16 22:14:04.426538 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:04.426501 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:14:04.426659 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:04.426600 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qw5dv" podUID="62bd794a-17be-4c5f-8140-dde7861a983b" Jul 16 22:14:05.425195 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:05.425152 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:14:05.425395 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:05.425323 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kh2w" podUID="6af5cc45-24ab-41f7-93b0-2f257139bed2" Jul 16 22:14:06.425331 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:06.424773 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:14:06.425331 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:06.424923 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfgnf" podUID="e9988a04-8333-4c15-91b9-bf93b1d1bdd9" Jul 16 22:14:06.425331 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:06.425195 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:14:06.425331 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:06.425289 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qw5dv" podUID="62bd794a-17be-4c5f-8140-dde7861a983b" Jul 16 22:14:07.424828 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:07.424799 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:14:07.425004 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:07.424908 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kh2w" podUID="6af5cc45-24ab-41f7-93b0-2f257139bed2" Jul 16 22:14:08.425344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:08.425306 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:14:08.425825 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:08.425456 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfgnf" podUID="e9988a04-8333-4c15-91b9-bf93b1d1bdd9" Jul 16 22:14:08.425825 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:08.425508 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:14:08.425825 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:08.425597 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qw5dv" podUID="62bd794a-17be-4c5f-8140-dde7861a983b" Jul 16 22:14:09.425025 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:09.424936 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:14:09.425186 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:09.425089 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kh2w" podUID="6af5cc45-24ab-41f7-93b0-2f257139bed2" Jul 16 22:14:10.424957 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:10.424921 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:14:10.425435 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:10.424925 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:14:10.425435 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:10.425054 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qw5dv" podUID="62bd794a-17be-4c5f-8140-dde7861a983b" Jul 16 22:14:10.425435 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:10.425173 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfgnf" podUID="e9988a04-8333-4c15-91b9-bf93b1d1bdd9" Jul 16 22:14:11.425283 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:11.425235 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:14:11.425797 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:11.425368 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kh2w" podUID="6af5cc45-24ab-41f7-93b0-2f257139bed2" Jul 16 22:14:12.095719 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:12.095691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs\") pod \"network-metrics-daemon-lfgnf\" (UID: \"e9988a04-8333-4c15-91b9-bf93b1d1bdd9\") " pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:14:12.095886 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:12.095733 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqlvk\" (UniqueName: \"kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk\") pod \"network-check-target-qw5dv\" (UID: \"62bd794a-17be-4c5f-8140-dde7861a983b\") " pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:14:12.095886 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:12.095767 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret\") pod \"global-pull-secret-syncer-5kh2w\" (UID: \"6af5cc45-24ab-41f7-93b0-2f257139bed2\") " pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:14:12.095886 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:12.095824 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 22:14:12.095886 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:12.095885 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs podName:e9988a04-8333-4c15-91b9-bf93b1d1bdd9 nodeName:}" failed. No retries permitted until 2026-07-16 22:14:28.09586933 +0000 UTC m=+34.198514538 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs") pod "network-metrics-daemon-lfgnf" (UID: "e9988a04-8333-4c15-91b9-bf93b1d1bdd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 22:14:12.096095 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:12.095887 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 22:14:12.096095 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:12.095915 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 22:14:12.096095 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:12.095932 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret podName:6af5cc45-24ab-41f7-93b0-2f257139bed2 nodeName:}" failed. No retries permitted until 2026-07-16 22:14:28.095920003 +0000 UTC m=+34.198565206 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret") pod "global-pull-secret-syncer-5kh2w" (UID: "6af5cc45-24ab-41f7-93b0-2f257139bed2") : object "kube-system"/"original-pull-secret" not registered Jul 16 22:14:12.096095 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:12.095940 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 22:14:12.096095 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:12.095954 2578 projected.go:196] Error preparing data for projected volume kube-api-access-nqlvk for pod openshift-network-diagnostics/network-check-target-qw5dv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 22:14:12.096095 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:12.096005 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk podName:62bd794a-17be-4c5f-8140-dde7861a983b nodeName:}" failed. No retries permitted until 2026-07-16 22:14:28.095990753 +0000 UTC m=+34.198635960 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqlvk" (UniqueName: "kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk") pod "network-check-target-qw5dv" (UID: "62bd794a-17be-4c5f-8140-dde7861a983b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 22:14:12.425293 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:12.425217 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:14:12.425447 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:12.425357 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfgnf" podUID="e9988a04-8333-4c15-91b9-bf93b1d1bdd9" Jul 16 22:14:12.425447 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:12.425437 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:14:12.425853 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:12.425543 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qw5dv" podUID="62bd794a-17be-4c5f-8140-dde7861a983b" Jul 16 22:14:13.424600 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:13.424569 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:14:13.424769 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:13.424682 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kh2w" podUID="6af5cc45-24ab-41f7-93b0-2f257139bed2" Jul 16 22:14:14.426413 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:14.426382 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:14:14.426901 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:14.426505 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfgnf" podUID="e9988a04-8333-4c15-91b9-bf93b1d1bdd9" Jul 16 22:14:14.426901 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:14.426574 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:14:14.426901 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:14.426684 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qw5dv" podUID="62bd794a-17be-4c5f-8140-dde7861a983b" Jul 16 22:14:15.424465 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:15.424432 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:14:15.424653 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:15.424557 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kh2w" podUID="6af5cc45-24ab-41f7-93b0-2f257139bed2" Jul 16 22:14:16.425278 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:16.425243 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:14:16.425840 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:16.425391 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfgnf" podUID="e9988a04-8333-4c15-91b9-bf93b1d1bdd9" Jul 16 22:14:16.425840 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:16.425445 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:14:16.425840 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:16.425541 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qw5dv" podUID="62bd794a-17be-4c5f-8140-dde7861a983b" Jul 16 22:14:17.425361 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:17.425333 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:14:17.425773 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:17.425460 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kh2w" podUID="6af5cc45-24ab-41f7-93b0-2f257139bed2" Jul 16 22:14:17.635722 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:17.635234 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-48dtb" event={"ID":"d01020ff-0f0b-4e2a-b9a3-921a789917f6","Type":"ContainerStarted","Data":"dffcd89b5167d7e52bae4921db411109cf8238b2cbed3b60b56b09dd030f355b"} Jul 16 22:14:17.638439 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:17.638411 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sktxq" event={"ID":"79fde428-77a9-46c5-8239-73be6e3df2c8","Type":"ContainerStarted","Data":"e97ab5942bed145845a0f1fd8b0088de8891241adb36809ce80db182608dd335"} Jul 16 22:14:17.640065 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:17.640043 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" event={"ID":"599d5e9b-73a5-426a-8343-d8084d70d101","Type":"ContainerStarted","Data":"171de9df4e67ba47434fa365c5d48f7853dbce6c400111af8a99e8a817c6a2dc"} Jul 16 22:14:17.641534 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:17.641511 2578 generic.go:356] "Generic (PLEG): container finished" podID="a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec" containerID="5eb24f97b91157eaf303fe118a93086687bb20cabcaa16e5ba717ee456451cbf" exitCode=0 Jul 16 22:14:17.641654 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:17.641599 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2b2s7" event={"ID":"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec","Type":"ContainerDied","Data":"5eb24f97b91157eaf303fe118a93086687bb20cabcaa16e5ba717ee456451cbf"} Jul 16 22:14:17.644348 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:17.644329 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" event={"ID":"ed956afc-2bf8-4635-99b2-75bbb6ee3974","Type":"ContainerStarted","Data":"0bb38db4994231b049f2c097e4a9fcd8538f0e0c8ba6cb51b4497e89d7ac8bf8"} Jul 16 22:14:17.644419 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:17.644400 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" event={"ID":"ed956afc-2bf8-4635-99b2-75bbb6ee3974","Type":"ContainerStarted","Data":"c237415376772861d42350ef67d4ce85b3525e18cdd2e48af63bd4815fda1e81"} Jul 16 22:14:17.644480 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:17.644443 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" event={"ID":"ed956afc-2bf8-4635-99b2-75bbb6ee3974","Type":"ContainerStarted","Data":"51707f3d36fb350781cdb2423e93cbf5542f16917ef99098cac5cc71084e6e7f"} Jul 16 22:14:17.644533 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:17.644491 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" event={"ID":"ed956afc-2bf8-4635-99b2-75bbb6ee3974","Type":"ContainerStarted","Data":"f1d48b10f42da25ccf83db2323c8bc8649eeab909739f1dbe27ae9f4aea7f260"} Jul 16 22:14:17.645924 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:17.645898 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xvjcl" event={"ID":"dd027fde-bcff-4cc5-a46c-37f4b1ec09b8","Type":"ContainerStarted","Data":"246c962a8422a78f187ad445f5be83c4dedb407638f25224e36cdb6ad76a2e82"} Jul 16 22:14:17.647517 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:17.647491 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mxsxh" event={"ID":"2b3b0098-10a8-4c53-9ed3-d99dfebb5d3f","Type":"ContainerStarted","Data":"be7f208f416696a6c7a54e4e579c7bbc564f3fdd3b18ec1bbc75db11db6ce2f8"} Jul 16 22:14:17.648904 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:17.648886 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" event={"ID":"974f32d3-1143-407b-9678-e911920634e4","Type":"ContainerStarted","Data":"4b85edea2ddf380a98b60525fbb92a290a3d1215f35a23f17e8b58bd4bbd5c2a"} Jul 16 22:14:17.652347 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:17.652300 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-48dtb" podStartSLOduration=3.044372505 podStartE2EDuration="22.65228694s" totalImagesPullingTime="19.607914435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:17.652229599 +0000 UTC m=+23.754874827" watchObservedRunningTime="2026-07-16 22:14:17.65228694 +0000 UTC m=+23.754932166" Jul 16 22:14:17.652427 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:17.652377 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-127.ec2.internal" podStartSLOduration=21.652371737 podStartE2EDuration="21.652371737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:13:59.608326306 +0000 UTC m=+5.710971576" watchObservedRunningTime="2026-07-16 22:14:17.652371737 +0000 UTC m=+23.755016962" Jul 16 22:14:17.668066 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:17.668034 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r5bxj" podStartSLOduration=3.063507096 podStartE2EDuration="22.668022644s" totalImagesPullingTime="19.604515548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:17.66790442 +0000 UTC m=+23.770549645" watchObservedRunningTime="2026-07-16 22:14:17.668022644 +0000 UTC m=+23.770667869" Jul 16 22:14:17.684286 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:17.684249 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xvjcl" podStartSLOduration=3.083999775 podStartE2EDuration="22.684237186s" totalImagesPullingTime="19.600237411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:17.683873089 +0000 UTC m=+23.786518315" watchObservedRunningTime="2026-07-16 22:14:17.684237186 +0000 UTC m=+23.786882412" Jul 16 22:14:17.720824 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:17.720788 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sktxq" podStartSLOduration=3.10417583 podStartE2EDuration="22.720775803s" totalImagesPullingTime="19.616599973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:17.720288581 +0000 UTC m=+23.822933806" watchObservedRunningTime="2026-07-16 22:14:17.720775803 +0000 UTC m=+23.823421029" Jul 16 22:14:17.748645 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:17.748607 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mxsxh" podStartSLOduration=3.084391652 podStartE2EDuration="22.748592681s" totalImagesPullingTime="19.664201029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:17.748477162 +0000 UTC m=+23.851122388" watchObservedRunningTime="2026-07-16 22:14:17.748592681 +0000 UTC m=+23.851237907" Jul 16 22:14:18.425364 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:18.425335 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:14:18.426183 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:18.425473 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfgnf" podUID="e9988a04-8333-4c15-91b9-bf93b1d1bdd9" Jul 16 22:14:18.426183 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:18.425528 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:14:18.426183 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:18.425638 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qw5dv" podUID="62bd794a-17be-4c5f-8140-dde7861a983b" Jul 16 22:14:18.652705 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:18.652669 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wx25f" event={"ID":"875bc679-2c82-428c-bef6-022a70b53063","Type":"ContainerStarted","Data":"13f883f87c5b38a79c1cdd9ae1f0000767ae780da82dc99ab1190a3772d1ae4d"} Jul 16 22:14:18.655816 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:18.655773 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" event={"ID":"ed956afc-2bf8-4635-99b2-75bbb6ee3974","Type":"ContainerStarted","Data":"768700b3bdf0064ae4593f2ad086851f9196e67b54a488f0cfe4609d684097ab"} Jul 16 22:14:18.655940 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:18.655877 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" event={"ID":"ed956afc-2bf8-4635-99b2-75bbb6ee3974","Type":"ContainerStarted","Data":"4861f8fa97deb12e356e74353e0b16f5395070c4680a95ad83ad23b88c01013f"} Jul 16 22:14:18.667295 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:18.667252 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wx25f" podStartSLOduration=4.055885852 podStartE2EDuration="23.667239126s" totalImagesPullingTime="19.611353274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:18.666881576 +0000 UTC m=+24.769526803" watchObservedRunningTime="2026-07-16 22:14:18.667239126 +0000 UTC m=+24.769884352" Jul 16 22:14:18.713061 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:18.713033 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 22:14:19.266228 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:19.266179 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xvjcl" Jul 16 22:14:19.266834 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:19.266811 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xvjcl" Jul 16 22:14:19.317287 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:19.317171 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T22:14:18.713058478Z","UUID":"f9d6d4c6-28de-426b-8b05-cd73377408dc","Handler":null,"Name":"","Endpoint":""} Jul 16 22:14:19.319307 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:19.319282 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 22:14:19.319449 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:19.319329 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 22:14:19.424428 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:19.424396 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:14:19.424595 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:19.424524 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kh2w" podUID="6af5cc45-24ab-41f7-93b0-2f257139bed2" Jul 16 22:14:19.660224 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:19.660134 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" event={"ID":"599d5e9b-73a5-426a-8343-d8084d70d101","Type":"ContainerStarted","Data":"056203c8bfa2abf0119b5dcd730009040677211a1f388de390712c1539647318"} Jul 16 22:14:19.660670 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:19.660375 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xvjcl" Jul 16 22:14:19.660859 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:19.660841 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xvjcl" Jul 16 22:14:20.424973 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:20.424898 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:14:20.425151 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:20.425066 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qw5dv" podUID="62bd794a-17be-4c5f-8140-dde7861a983b" Jul 16 22:14:20.425151 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:20.425112 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:14:20.425276 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:20.425218 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfgnf" podUID="e9988a04-8333-4c15-91b9-bf93b1d1bdd9" Jul 16 22:14:20.664904 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:20.664665 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" event={"ID":"599d5e9b-73a5-426a-8343-d8084d70d101","Type":"ContainerStarted","Data":"a8ac82cec9d232e52b526c52b48cf78665f60b10e213891ac680c64e14b96150"} Jul 16 22:14:20.668507 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:20.668472 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" event={"ID":"ed956afc-2bf8-4635-99b2-75bbb6ee3974","Type":"ContainerStarted","Data":"9e63a35a9708eadfa3799be85475d16085204fdc12d19f3c62f58d4d4713d659"} Jul 16 22:14:20.684540 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:20.684466 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6swx" podStartSLOduration=3.688308841 podStartE2EDuration="25.684453661s" totalImagesPullingTime="21.99614482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:20.682949355 +0000 UTC m=+26.785594602" watchObservedRunningTime="2026-07-16 22:14:20.684453661 +0000 UTC m=+26.787098887" Jul 16 22:14:21.424973 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:21.424775 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:14:21.425160 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:21.425085 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kh2w" podUID="6af5cc45-24ab-41f7-93b0-2f257139bed2" Jul 16 22:14:22.425331 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:22.425166 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:14:22.425961 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:22.425226 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:14:22.425961 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:22.425423 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfgnf" podUID="e9988a04-8333-4c15-91b9-bf93b1d1bdd9" Jul 16 22:14:22.425961 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:22.425473 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qw5dv" podUID="62bd794a-17be-4c5f-8140-dde7861a983b" Jul 16 22:14:22.675946 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:22.675862 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" event={"ID":"ed956afc-2bf8-4635-99b2-75bbb6ee3974","Type":"ContainerStarted","Data":"149cc75ef56094a515f95a90877395158941fe829c8ea9f1107c4cfea5bd63bf"} Jul 16 22:14:22.676205 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:22.676173 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:14:22.676340 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:22.676257 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:14:22.676340 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:22.676303 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:14:22.677841 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:22.677819 2578 generic.go:356] "Generic (PLEG): container finished" podID="a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec" containerID="f58884fda95c8fc091512bb9dd48d1d93120724a4b707d2684cb2e2baf8ca741" exitCode=0 Jul 16 22:14:22.677955 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:22.677847 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2b2s7" event={"ID":"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec","Type":"ContainerDied","Data":"f58884fda95c8fc091512bb9dd48d1d93120724a4b707d2684cb2e2baf8ca741"} Jul 16 22:14:22.691765 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:22.691748 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:14:22.692156 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:22.692140 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:14:22.706940 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:22.706901 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" podStartSLOduration=8.018368543 podStartE2EDuration="27.706889753s" totalImagesPullingTime="19.68852121s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:22.706223571 +0000 UTC m=+28.808868815" watchObservedRunningTime="2026-07-16 22:14:22.706889753 +0000 UTC m=+28.809534978" Jul 16 22:14:23.424964 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:23.424920 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:14:23.425238 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:23.425065 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kh2w" podUID="6af5cc45-24ab-41f7-93b0-2f257139bed2" Jul 16 22:14:24.334939 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:24.334902 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5kh2w"] Jul 16 22:14:24.335433 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:24.335012 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:14:24.335433 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:24.335145 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kh2w" podUID="6af5cc45-24ab-41f7-93b0-2f257139bed2" Jul 16 22:14:24.338274 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:24.338244 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qw5dv"] Jul 16 22:14:24.338444 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:24.338392 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:14:24.338538 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:24.338502 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qw5dv" podUID="62bd794a-17be-4c5f-8140-dde7861a983b" Jul 16 22:14:24.339029 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:24.338997 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lfgnf"] Jul 16 22:14:24.339171 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:24.339112 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:14:24.339235 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:24.339202 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfgnf" podUID="e9988a04-8333-4c15-91b9-bf93b1d1bdd9" Jul 16 22:14:24.684329 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:24.684297 2578 generic.go:356] "Generic (PLEG): container finished" podID="a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec" containerID="e1f85bf1c50c8308870619601bf7b932716375e2aa1e7d22f76b582cd966f0d1" exitCode=0 Jul 16 22:14:24.684526 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:24.684374 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2b2s7" event={"ID":"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec","Type":"ContainerDied","Data":"e1f85bf1c50c8308870619601bf7b932716375e2aa1e7d22f76b582cd966f0d1"} Jul 16 22:14:26.425149 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:26.424894 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:14:26.425149 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:26.424890 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:14:26.425646 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:26.425167 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kh2w" podUID="6af5cc45-24ab-41f7-93b0-2f257139bed2" Jul 16 22:14:26.425646 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:26.424938 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:14:26.425646 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:26.425221 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qw5dv" podUID="62bd794a-17be-4c5f-8140-dde7861a983b" Jul 16 22:14:26.425646 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:26.425318 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfgnf" podUID="e9988a04-8333-4c15-91b9-bf93b1d1bdd9" Jul 16 22:14:26.691595 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:26.691564 2578 generic.go:356] "Generic (PLEG): container finished" podID="a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec" containerID="96923bcb0154f4512e61244f9ad69926101cbc13aab381e3d53d13abaf19c051" exitCode=0 Jul 16 22:14:26.691751 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:26.691626 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2b2s7" event={"ID":"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec","Type":"ContainerDied","Data":"96923bcb0154f4512e61244f9ad69926101cbc13aab381e3d53d13abaf19c051"} Jul 16 22:14:28.116272 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:28.116235 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs\") pod \"network-metrics-daemon-lfgnf\" (UID: \"e9988a04-8333-4c15-91b9-bf93b1d1bdd9\") " pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:14:28.116773 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:28.116283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqlvk\" (UniqueName: \"kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk\") pod \"network-check-target-qw5dv\" (UID: \"62bd794a-17be-4c5f-8140-dde7861a983b\") " pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:14:28.116773 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:28.116314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret\") pod \"global-pull-secret-syncer-5kh2w\" (UID: \"6af5cc45-24ab-41f7-93b0-2f257139bed2\") " pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:14:28.116773 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:28.116412 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 22:14:28.116773 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:28.116488 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs podName:e9988a04-8333-4c15-91b9-bf93b1d1bdd9 nodeName:}" failed. No retries permitted until 2026-07-16 22:15:00.116468161 +0000 UTC m=+66.219113372 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs") pod "network-metrics-daemon-lfgnf" (UID: "e9988a04-8333-4c15-91b9-bf93b1d1bdd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 22:14:28.116773 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:28.116417 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 22:14:28.116773 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:28.116558 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret podName:6af5cc45-24ab-41f7-93b0-2f257139bed2 nodeName:}" failed. No retries permitted until 2026-07-16 22:15:00.116545878 +0000 UTC m=+66.219191085 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret") pod "global-pull-secret-syncer-5kh2w" (UID: "6af5cc45-24ab-41f7-93b0-2f257139bed2") : object "kube-system"/"original-pull-secret" not registered Jul 16 22:14:28.116773 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:28.116422 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 22:14:28.116773 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:28.116580 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 22:14:28.116773 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:28.116595 2578 projected.go:196] Error preparing data for projected volume kube-api-access-nqlvk for pod openshift-network-diagnostics/network-check-target-qw5dv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 22:14:28.116773 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:28.116636 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk podName:62bd794a-17be-4c5f-8140-dde7861a983b nodeName:}" failed. No retries permitted until 2026-07-16 22:15:00.11662262 +0000 UTC m=+66.219267839 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqlvk" (UniqueName: "kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk") pod "network-check-target-qw5dv" (UID: "62bd794a-17be-4c5f-8140-dde7861a983b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 22:14:28.425455 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:28.425360 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:14:28.425603 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:28.425361 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:14:28.425603 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:28.425538 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:14:28.425603 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:28.425531 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfgnf" podUID="e9988a04-8333-4c15-91b9-bf93b1d1bdd9" Jul 16 22:14:28.425766 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:28.425636 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qw5dv" podUID="62bd794a-17be-4c5f-8140-dde7861a983b" Jul 16 22:14:28.425766 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:28.425723 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kh2w" podUID="6af5cc45-24ab-41f7-93b0-2f257139bed2" Jul 16 22:14:30.269482 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.269451 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-127.ec2.internal" event="NodeReady" Jul 16 22:14:30.269977 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.269591 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 22:14:30.320390 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.320356 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tsh7f"] Jul 16 22:14:30.351142 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.350973 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w89ct"] Jul 16 22:14:30.351475 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.351093 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tsh7f" Jul 16 22:14:30.355880 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.355857 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 22:14:30.356029 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.355926 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 22:14:30.356101 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.356045 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gpmss\"" Jul 16 22:14:30.369757 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.369724 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tsh7f"] Jul 16 22:14:30.369844 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.369775 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w89ct"] Jul 16 22:14:30.369844 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.369787 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w89ct" Jul 16 22:14:30.373564 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.373543 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 22:14:30.373830 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.373808 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 22:14:30.373915 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.373876 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7zbvf\"" Jul 16 22:14:30.373915 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.373808 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 22:14:30.424448 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.424419 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:14:30.424593 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.424528 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:14:30.424654 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.424426 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:14:30.427475 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.427358 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 22:14:30.427652 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.427631 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7sbmm\"" Jul 16 22:14:30.427770 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.427679 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 22:14:30.427835 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.427771 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 22:14:30.427835 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.427795 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 22:14:30.427993 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.427897 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kkg55\"" Jul 16 22:14:30.434875 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.434851 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flq8z\" (UniqueName: \"kubernetes.io/projected/d63ed4f5-feea-48bd-ab8b-c7249e46501b-kube-api-access-flq8z\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:14:30.434995 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.434907 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d63ed4f5-feea-48bd-ab8b-c7249e46501b-tmp-dir\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:14:30.434995 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.434972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d63ed4f5-feea-48bd-ab8b-c7249e46501b-config-volume\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:14:30.435127 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.435105 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:14:30.536460 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.536381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:14:30.536614 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:30.536542 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 22:14:30.536664 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:30.536627 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls podName:d63ed4f5-feea-48bd-ab8b-c7249e46501b nodeName:}" failed. No retries permitted until 2026-07-16 22:14:31.036608979 +0000 UTC m=+37.139254184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls") pod "dns-default-tsh7f" (UID: "d63ed4f5-feea-48bd-ab8b-c7249e46501b") : secret "dns-default-metrics-tls" not found Jul 16 22:14:30.536866 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.536423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1a73a64-eee7-4065-9598-d8079291529a-cert\") pod \"ingress-canary-w89ct\" (UID: \"b1a73a64-eee7-4065-9598-d8079291529a\") " pod="openshift-ingress-canary/ingress-canary-w89ct" Jul 16 22:14:30.536960 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.536897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flq8z\" (UniqueName: \"kubernetes.io/projected/d63ed4f5-feea-48bd-ab8b-c7249e46501b-kube-api-access-flq8z\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:14:30.536960 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.536940 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d63ed4f5-feea-48bd-ab8b-c7249e46501b-tmp-dir\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:14:30.537043 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.536982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d63ed4f5-feea-48bd-ab8b-c7249e46501b-config-volume\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:14:30.537043 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.537017 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vndbt\" (UniqueName: \"kubernetes.io/projected/b1a73a64-eee7-4065-9598-d8079291529a-kube-api-access-vndbt\") pod \"ingress-canary-w89ct\" (UID: \"b1a73a64-eee7-4065-9598-d8079291529a\") " pod="openshift-ingress-canary/ingress-canary-w89ct" Jul 16 22:14:30.537379 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.537359 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d63ed4f5-feea-48bd-ab8b-c7249e46501b-tmp-dir\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:14:30.537669 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.537648 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d63ed4f5-feea-48bd-ab8b-c7249e46501b-config-volume\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:14:30.548693 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.548671 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flq8z\" (UniqueName: \"kubernetes.io/projected/d63ed4f5-feea-48bd-ab8b-c7249e46501b-kube-api-access-flq8z\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:14:30.638258 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.638219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vndbt\" (UniqueName: \"kubernetes.io/projected/b1a73a64-eee7-4065-9598-d8079291529a-kube-api-access-vndbt\") pod \"ingress-canary-w89ct\" (UID: \"b1a73a64-eee7-4065-9598-d8079291529a\") " pod="openshift-ingress-canary/ingress-canary-w89ct" Jul 16 22:14:30.638434 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.638290 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1a73a64-eee7-4065-9598-d8079291529a-cert\") pod \"ingress-canary-w89ct\" (UID: \"b1a73a64-eee7-4065-9598-d8079291529a\") " pod="openshift-ingress-canary/ingress-canary-w89ct" Jul 16 22:14:30.641952 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.641688 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1a73a64-eee7-4065-9598-d8079291529a-cert\") pod \"ingress-canary-w89ct\" (UID: \"b1a73a64-eee7-4065-9598-d8079291529a\") " pod="openshift-ingress-canary/ingress-canary-w89ct" Jul 16 22:14:30.649183 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.649162 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vndbt\" (UniqueName: \"kubernetes.io/projected/b1a73a64-eee7-4065-9598-d8079291529a-kube-api-access-vndbt\") pod \"ingress-canary-w89ct\" (UID: \"b1a73a64-eee7-4065-9598-d8079291529a\") " pod="openshift-ingress-canary/ingress-canary-w89ct" Jul 16 22:14:30.680085 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:30.680043 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w89ct" Jul 16 22:14:31.040740 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:31.040707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:14:31.040854 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:31.040816 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 22:14:31.040899 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:31.040867 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls podName:d63ed4f5-feea-48bd-ab8b-c7249e46501b nodeName:}" failed. No retries permitted until 2026-07-16 22:14:32.040853323 +0000 UTC m=+38.143498527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls") pod "dns-default-tsh7f" (UID: "d63ed4f5-feea-48bd-ab8b-c7249e46501b") : secret "dns-default-metrics-tls" not found Jul 16 22:14:31.064725 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:31.064693 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w89ct"] Jul 16 22:14:31.107297 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:14:31.107269 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1a73a64_eee7_4065_9598_d8079291529a.slice/crio-122171ea8266810af38a80f34aa0a6cfb12acfd0a9f7ee0cdee156a3c452b189 WatchSource:0}: Error finding container 122171ea8266810af38a80f34aa0a6cfb12acfd0a9f7ee0cdee156a3c452b189: Status 404 returned error can't find the container with id 122171ea8266810af38a80f34aa0a6cfb12acfd0a9f7ee0cdee156a3c452b189 Jul 16 22:14:31.704943 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:31.704910 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w89ct" event={"ID":"b1a73a64-eee7-4065-9598-d8079291529a","Type":"ContainerStarted","Data":"122171ea8266810af38a80f34aa0a6cfb12acfd0a9f7ee0cdee156a3c452b189"} Jul 16 22:14:31.707552 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:31.707523 2578 generic.go:356] "Generic (PLEG): container finished" podID="a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec" containerID="a626ffcf03c19474273407abe76434c65f5def46af304a7708ac30223b061e7f" exitCode=0 Jul 16 22:14:31.707688 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:31.707560 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2b2s7" event={"ID":"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec","Type":"ContainerDied","Data":"a626ffcf03c19474273407abe76434c65f5def46af304a7708ac30223b061e7f"} Jul 16 22:14:32.048465 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:32.048380 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:14:32.048617 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:32.048550 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 22:14:32.048672 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:32.048616 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls podName:d63ed4f5-feea-48bd-ab8b-c7249e46501b nodeName:}" failed. No retries permitted until 2026-07-16 22:14:34.048600967 +0000 UTC m=+40.151246170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls") pod "dns-default-tsh7f" (UID: "d63ed4f5-feea-48bd-ab8b-c7249e46501b") : secret "dns-default-metrics-tls" not found Jul 16 22:14:32.713863 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:32.713829 2578 generic.go:356] "Generic (PLEG): container finished" podID="a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec" containerID="d55b72f1aac2b32a091dfea46b84d6c6b17956d27112f7e95527d7c2cdd8bdac" exitCode=0 Jul 16 22:14:32.714339 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:32.713915 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2b2s7" event={"ID":"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec","Type":"ContainerDied","Data":"d55b72f1aac2b32a091dfea46b84d6c6b17956d27112f7e95527d7c2cdd8bdac"} Jul 16 22:14:33.717835 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:33.717800 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w89ct" event={"ID":"b1a73a64-eee7-4065-9598-d8079291529a","Type":"ContainerStarted","Data":"a1592ff0934944e0ecacdc79a6a11738d19d901181e2e7e46570de70f7b430f5"} Jul 16 22:14:33.721296 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:33.721274 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2b2s7" event={"ID":"a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec","Type":"ContainerStarted","Data":"5e9584d4a9c784abfe730eaccbc100412996b0c558a3ddef79e4d21b363cf88b"} Jul 16 22:14:33.737238 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:33.737195 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w89ct" podStartSLOduration=1.307142392 podStartE2EDuration="3.73718146s" totalImagesPullingTime="2.430039068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:33.736565527 +0000 UTC m=+39.839210754" watchObservedRunningTime="2026-07-16 22:14:33.73718146 +0000 UTC m=+39.839826686" Jul 16 22:14:33.760694 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:33.760638 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2b2s7" podStartSLOduration=8.015306644 podStartE2EDuration="38.76061834s" totalImagesPullingTime="30.745311696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:33.758584015 +0000 UTC m=+39.861229261" watchObservedRunningTime="2026-07-16 22:14:33.76061834 +0000 UTC m=+39.863263567" Jul 16 22:14:34.062771 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:34.062718 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:14:34.063018 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:34.062849 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 22:14:34.063018 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:34.062903 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls podName:d63ed4f5-feea-48bd-ab8b-c7249e46501b nodeName:}" failed. No retries permitted until 2026-07-16 22:14:38.062887904 +0000 UTC m=+44.165533108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls") pod "dns-default-tsh7f" (UID: "d63ed4f5-feea-48bd-ab8b-c7249e46501b") : secret "dns-default-metrics-tls" not found Jul 16 22:14:38.088474 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:38.088435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:14:38.088829 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:38.088544 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 22:14:38.088829 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:38.088594 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls podName:d63ed4f5-feea-48bd-ab8b-c7249e46501b nodeName:}" failed. No retries permitted until 2026-07-16 22:14:46.088581072 +0000 UTC m=+52.191226280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls") pod "dns-default-tsh7f" (UID: "d63ed4f5-feea-48bd-ab8b-c7249e46501b") : secret "dns-default-metrics-tls" not found Jul 16 22:14:46.143445 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:46.143402 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:14:46.143923 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:46.143584 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 22:14:46.143923 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:14:46.143670 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls podName:d63ed4f5-feea-48bd-ab8b-c7249e46501b nodeName:}" failed. No retries permitted until 2026-07-16 22:15:02.143644649 +0000 UTC m=+68.246289854 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls") pod "dns-default-tsh7f" (UID: "d63ed4f5-feea-48bd-ab8b-c7249e46501b") : secret "dns-default-metrics-tls" not found Jul 16 22:14:54.695002 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:14:54.694973 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kxm9g" Jul 16 22:15:00.138985 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:00.138942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs\") pod \"network-metrics-daemon-lfgnf\" (UID: \"e9988a04-8333-4c15-91b9-bf93b1d1bdd9\") " pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:15:00.138985 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:00.138986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqlvk\" (UniqueName: \"kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk\") pod \"network-check-target-qw5dv\" (UID: \"62bd794a-17be-4c5f-8140-dde7861a983b\") " pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:15:00.139839 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:00.139011 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret\") pod \"global-pull-secret-syncer-5kh2w\" (UID: \"6af5cc45-24ab-41f7-93b0-2f257139bed2\") " pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:15:00.142142 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:00.142125 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 22:15:00.142198 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:00.142131 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 22:15:00.142246 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:00.142229 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 22:15:00.149558 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:15:00.149537 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 22:15:00.149662 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:15:00.149606 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs podName:e9988a04-8333-4c15-91b9-bf93b1d1bdd9 nodeName:}" failed. No retries permitted until 2026-07-16 22:16:04.149590624 +0000 UTC m=+130.252235829 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs") pod "network-metrics-daemon-lfgnf" (UID: "e9988a04-8333-4c15-91b9-bf93b1d1bdd9") : secret "metrics-daemon-secret" not found Jul 16 22:15:00.152018 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:00.152002 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 22:15:00.153343 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:00.153324 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af5cc45-24ab-41f7-93b0-2f257139bed2-original-pull-secret\") pod \"global-pull-secret-syncer-5kh2w\" (UID: \"6af5cc45-24ab-41f7-93b0-2f257139bed2\") " pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:15:00.162381 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:00.162362 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqlvk\" (UniqueName: \"kubernetes.io/projected/62bd794a-17be-4c5f-8140-dde7861a983b-kube-api-access-nqlvk\") pod \"network-check-target-qw5dv\" (UID: \"62bd794a-17be-4c5f-8140-dde7861a983b\") " pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:15:00.438496 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:00.438421 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kkg55\"" Jul 16 22:15:00.442835 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:00.442816 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kh2w" Jul 16 22:15:00.446219 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:00.446203 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:15:00.573871 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:00.573844 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qw5dv"] Jul 16 22:15:00.577252 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:15:00.577227 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62bd794a_17be_4c5f_8140_dde7861a983b.slice/crio-6f1bab2a1936ab975cb04b808706daa6dc3c8e6037808f24676a67039eecb33d WatchSource:0}: Error finding container 6f1bab2a1936ab975cb04b808706daa6dc3c8e6037808f24676a67039eecb33d: Status 404 returned error can't find the container with id 6f1bab2a1936ab975cb04b808706daa6dc3c8e6037808f24676a67039eecb33d Jul 16 22:15:00.586654 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:00.586633 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5kh2w"] Jul 16 22:15:00.589327 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:15:00.589303 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6af5cc45_24ab_41f7_93b0_2f257139bed2.slice/crio-6d0a47c035024f13ff106e8ef3fc4f2159c6091a90c06770589deb77f40418e6 WatchSource:0}: Error finding container 6d0a47c035024f13ff106e8ef3fc4f2159c6091a90c06770589deb77f40418e6: Status 404 returned error can't find the container with id 6d0a47c035024f13ff106e8ef3fc4f2159c6091a90c06770589deb77f40418e6 Jul 16 22:15:00.785390 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:00.785356 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qw5dv" event={"ID":"62bd794a-17be-4c5f-8140-dde7861a983b","Type":"ContainerStarted","Data":"6f1bab2a1936ab975cb04b808706daa6dc3c8e6037808f24676a67039eecb33d"} Jul 16 22:15:00.786368 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:00.786345 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5kh2w" event={"ID":"6af5cc45-24ab-41f7-93b0-2f257139bed2","Type":"ContainerStarted","Data":"6d0a47c035024f13ff106e8ef3fc4f2159c6091a90c06770589deb77f40418e6"} Jul 16 22:15:02.152541 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:02.152442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:15:02.153001 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:15:02.152627 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 22:15:02.153001 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:15:02.152710 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls podName:d63ed4f5-feea-48bd-ab8b-c7249e46501b nodeName:}" failed. No retries permitted until 2026-07-16 22:15:34.152688576 +0000 UTC m=+100.255333787 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls") pod "dns-default-tsh7f" (UID: "d63ed4f5-feea-48bd-ab8b-c7249e46501b") : secret "dns-default-metrics-tls" not found Jul 16 22:15:05.803301 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:05.803224 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qw5dv" event={"ID":"62bd794a-17be-4c5f-8140-dde7861a983b","Type":"ContainerStarted","Data":"53fdac4bcdb60927e530ceb16e8212eea9efce5edcc21eb8d51f34419f6aac55"} Jul 16 22:15:05.803742 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:05.803311 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:15:05.804695 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:05.804673 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5kh2w" event={"ID":"6af5cc45-24ab-41f7-93b0-2f257139bed2","Type":"ContainerStarted","Data":"911ddfd554ef81c2f2856782ad3319e57b931de214f731755e8c565eb179e376"} Jul 16 22:15:05.833178 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:05.833133 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qw5dv" podStartSLOduration=65.87036157 podStartE2EDuration="1m10.83312011s" totalImagesPullingTime="4.96275854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:15:05.832235413 +0000 UTC m=+71.934880655" watchObservedRunningTime="2026-07-16 22:15:05.83312011 +0000 UTC m=+71.935765333" Jul 16 22:15:05.859689 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:05.859647 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5kh2w" podStartSLOduration=65.897709433 podStartE2EDuration="1m10.859634049s" totalImagesPullingTime="4.961924616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:15:05.859596956 +0000 UTC m=+71.962242182" watchObservedRunningTime="2026-07-16 22:15:05.859634049 +0000 UTC m=+71.962279275" Jul 16 22:15:34.170198 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:34.170067 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:15:34.170198 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:15:34.170178 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 22:15:34.170645 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:15:34.170255 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls podName:d63ed4f5-feea-48bd-ab8b-c7249e46501b nodeName:}" failed. No retries permitted until 2026-07-16 22:16:38.170239522 +0000 UTC m=+164.272884726 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls") pod "dns-default-tsh7f" (UID: "d63ed4f5-feea-48bd-ab8b-c7249e46501b") : secret "dns-default-metrics-tls" not found Jul 16 22:15:36.810648 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:15:36.810614 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qw5dv" Jul 16 22:16:04.176012 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:16:04.175959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs\") pod \"network-metrics-daemon-lfgnf\" (UID: \"e9988a04-8333-4c15-91b9-bf93b1d1bdd9\") " pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:16:04.176535 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:16:04.176137 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 22:16:04.176535 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:16:04.176211 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs podName:e9988a04-8333-4c15-91b9-bf93b1d1bdd9 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:06.176195015 +0000 UTC m=+252.278840219 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs") pod "network-metrics-daemon-lfgnf" (UID: "e9988a04-8333-4c15-91b9-bf93b1d1bdd9") : secret "metrics-daemon-secret" not found Jul 16 22:16:33.361584 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:16:33.361543 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tsh7f" podUID="d63ed4f5-feea-48bd-ab8b-c7249e46501b" Jul 16 22:16:33.448434 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:16:33.448383 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lfgnf" podUID="e9988a04-8333-4c15-91b9-bf93b1d1bdd9" Jul 16 22:16:34.007855 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:16:34.007780 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tsh7f" Jul 16 22:16:38.195437 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:16:38.195397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:16:38.195859 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:16:38.195543 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 22:16:38.195859 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:16:38.195600 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls podName:d63ed4f5-feea-48bd-ab8b-c7249e46501b nodeName:}" failed. No retries permitted until 2026-07-16 22:18:40.195585104 +0000 UTC m=+286.298230313 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls") pod "dns-default-tsh7f" (UID: "d63ed4f5-feea-48bd-ab8b-c7249e46501b") : secret "dns-default-metrics-tls" not found Jul 16 22:16:48.425460 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:16:48.425380 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:18:06.274950 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:06.274911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs\") pod \"network-metrics-daemon-lfgnf\" (UID: \"e9988a04-8333-4c15-91b9-bf93b1d1bdd9\") " pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:18:06.275488 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:06.275039 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 22:18:06.275488 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:06.275119 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs podName:e9988a04-8333-4c15-91b9-bf93b1d1bdd9 nodeName:}" failed. No retries permitted until 2026-07-16 22:20:08.275102836 +0000 UTC m=+374.377748041 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs") pod "network-metrics-daemon-lfgnf" (UID: "e9988a04-8333-4c15-91b9-bf93b1d1bdd9") : secret "metrics-daemon-secret" not found Jul 16 22:18:07.382464 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.382416 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-x9kn9"] Jul 16 22:18:07.383997 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.383975 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-mx9vm"] Jul 16 22:18:07.384163 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.384132 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.385664 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.385643 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" Jul 16 22:18:07.385747 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.385681 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq"] Jul 16 22:18:07.387448 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.387429 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq" Jul 16 22:18:07.389444 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.389421 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 22:18:07.391417 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.391397 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-nfckr\"" Jul 16 22:18:07.392848 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.392834 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 16 22:18:07.393330 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.393304 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 16 22:18:07.393412 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.393352 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 16 22:18:07.393412 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.393393 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 16 22:18:07.393498 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.393422 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 22:18:07.394344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.394315 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 22:18:07.394429 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.394383 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 22:18:07.395793 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.395775 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-97nl8\"" Jul 16 22:18:07.396738 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.396704 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 16 22:18:07.396873 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.396760 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 16 22:18:07.396873 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.396766 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 16 22:18:07.401529 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.401511 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-m2c4f\"" Jul 16 22:18:07.417998 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.417957 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 16 22:18:07.419968 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.419942 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 16 22:18:07.420123 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.419979 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq"] Jul 16 22:18:07.420635 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.420619 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-mx9vm"] Jul 16 22:18:07.423696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.423671 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 16 22:18:07.432413 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.432382 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-x9kn9"] Jul 16 22:18:07.461791 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.461754 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-qjbft"] Jul 16 22:18:07.466347 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.466088 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-qjbft" Jul 16 22:18:07.468818 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.468789 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d47db56d-wvf5f"] Jul 16 22:18:07.468962 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.468821 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gzcbq\"" Jul 16 22:18:07.470815 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.470794 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.479004 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.478857 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 22:18:07.479918 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.479892 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 22:18:07.480592 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.480573 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jdxhv\"" Jul 16 22:18:07.481299 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.481283 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 22:18:07.481762 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.481744 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1842e1a9-c878-48f6-a65c-97d722626fbd-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-x9kn9\" (UID: \"1842e1a9-c878-48f6-a65c-97d722626fbd\") " pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.481808 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.481785 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-t7slq\" (UID: \"5b5980c2-7b9e-4074-bfef-4ac10d58cd34\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq" Jul 16 22:18:07.481878 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.481862 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1842e1a9-c878-48f6-a65c-97d722626fbd-service-ca-bundle\") pod \"insights-operator-555d9d7885-x9kn9\" (UID: \"1842e1a9-c878-48f6-a65c-97d722626fbd\") " pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.481929 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.481896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1842e1a9-c878-48f6-a65c-97d722626fbd-snapshots\") pod \"insights-operator-555d9d7885-x9kn9\" (UID: \"1842e1a9-c878-48f6-a65c-97d722626fbd\") " pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.481929 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.481915 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1842e1a9-c878-48f6-a65c-97d722626fbd-serving-cert\") pod \"insights-operator-555d9d7885-x9kn9\" (UID: \"1842e1a9-c878-48f6-a65c-97d722626fbd\") " pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.482010 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.481929 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8cdcab86-40b1-4f9f-b6cb-d95773289927-serving-cert\") pod \"console-operator-565b7b569d-mx9vm\" (UID: \"8cdcab86-40b1-4f9f-b6cb-d95773289927\") " pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" Jul 16 22:18:07.482010 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.481946 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm5gl\" (UniqueName: \"kubernetes.io/projected/8cdcab86-40b1-4f9f-b6cb-d95773289927-kube-api-access-fm5gl\") pod \"console-operator-565b7b569d-mx9vm\" (UID: \"8cdcab86-40b1-4f9f-b6cb-d95773289927\") " pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" Jul 16 22:18:07.482010 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.481968 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-t7slq\" (UID: \"5b5980c2-7b9e-4074-bfef-4ac10d58cd34\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq" Jul 16 22:18:07.482010 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.481997 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cdcab86-40b1-4f9f-b6cb-d95773289927-config\") pod \"console-operator-565b7b569d-mx9vm\" (UID: \"8cdcab86-40b1-4f9f-b6cb-d95773289927\") " pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" Jul 16 22:18:07.482170 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.482015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8cdcab86-40b1-4f9f-b6cb-d95773289927-trusted-ca\") pod \"console-operator-565b7b569d-mx9vm\" (UID: \"8cdcab86-40b1-4f9f-b6cb-d95773289927\") " pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" Jul 16 22:18:07.482170 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.482032 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1842e1a9-c878-48f6-a65c-97d722626fbd-tmp\") pod \"insights-operator-555d9d7885-x9kn9\" (UID: \"1842e1a9-c878-48f6-a65c-97d722626fbd\") " pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.482170 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.482048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fd8g\" (UniqueName: \"kubernetes.io/projected/1842e1a9-c878-48f6-a65c-97d722626fbd-kube-api-access-5fd8g\") pod \"insights-operator-555d9d7885-x9kn9\" (UID: \"1842e1a9-c878-48f6-a65c-97d722626fbd\") " pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.482170 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.482083 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7zvs\" (UniqueName: \"kubernetes.io/projected/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-kube-api-access-z7zvs\") pod \"cluster-monitoring-operator-76cf8966f8-t7slq\" (UID: \"5b5980c2-7b9e-4074-bfef-4ac10d58cd34\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq" Jul 16 22:18:07.484679 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.484663 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 22:18:07.493005 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.492963 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-qjbft"] Jul 16 22:18:07.493961 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.493932 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d47db56d-wvf5f"] Jul 16 22:18:07.583195 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.583162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cdcab86-40b1-4f9f-b6cb-d95773289927-config\") pod \"console-operator-565b7b569d-mx9vm\" (UID: \"8cdcab86-40b1-4f9f-b6cb-d95773289927\") " pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" Jul 16 22:18:07.583195 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.583200 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fd8g\" (UniqueName: \"kubernetes.io/projected/1842e1a9-c878-48f6-a65c-97d722626fbd-kube-api-access-5fd8g\") pod \"insights-operator-555d9d7885-x9kn9\" (UID: \"1842e1a9-c878-48f6-a65c-97d722626fbd\") " pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.583421 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.583223 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1842e1a9-c878-48f6-a65c-97d722626fbd-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-x9kn9\" (UID: \"1842e1a9-c878-48f6-a65c-97d722626fbd\") " pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.583421 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.583249 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-certificates\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.583421 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.583354 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-t7slq\" (UID: \"5b5980c2-7b9e-4074-bfef-4ac10d58cd34\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq" Jul 16 22:18:07.583421 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.583402 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7zvs\" (UniqueName: \"kubernetes.io/projected/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-kube-api-access-z7zvs\") pod \"cluster-monitoring-operator-76cf8966f8-t7slq\" (UID: \"5b5980c2-7b9e-4074-bfef-4ac10d58cd34\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq" Jul 16 22:18:07.583614 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.583426 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-ca-trust-extracted\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.583614 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.583447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wczv7\" (UniqueName: \"kubernetes.io/projected/0d290bb5-df48-4edf-b1fb-44e4d2547663-kube-api-access-wczv7\") pod \"network-check-source-7bc5b6bf85-qjbft\" (UID: \"0d290bb5-df48-4edf-b1fb-44e4d2547663\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-qjbft" Jul 16 22:18:07.583614 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.583465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1842e1a9-c878-48f6-a65c-97d722626fbd-service-ca-bundle\") pod \"insights-operator-555d9d7885-x9kn9\" (UID: \"1842e1a9-c878-48f6-a65c-97d722626fbd\") " pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.583614 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.583479 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1842e1a9-c878-48f6-a65c-97d722626fbd-snapshots\") pod \"insights-operator-555d9d7885-x9kn9\" (UID: \"1842e1a9-c878-48f6-a65c-97d722626fbd\") " pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.583614 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.583506 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8cdcab86-40b1-4f9f-b6cb-d95773289927-trusted-ca\") pod \"console-operator-565b7b569d-mx9vm\" (UID: \"8cdcab86-40b1-4f9f-b6cb-d95773289927\") " pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" Jul 16 22:18:07.583854 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.583724 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1842e1a9-c878-48f6-a65c-97d722626fbd-tmp\") pod \"insights-operator-555d9d7885-x9kn9\" (UID: \"1842e1a9-c878-48f6-a65c-97d722626fbd\") " pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.583854 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.583793 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cttxb\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-kube-api-access-cttxb\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.583854 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.583830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-bound-sa-token\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.583966 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.583858 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.584087 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.584054 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cdcab86-40b1-4f9f-b6cb-d95773289927-config\") pod \"console-operator-565b7b569d-mx9vm\" (UID: \"8cdcab86-40b1-4f9f-b6cb-d95773289927\") " pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" Jul 16 22:18:07.584169 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.584152 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-t7slq\" (UID: \"5b5980c2-7b9e-4074-bfef-4ac10d58cd34\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq" Jul 16 22:18:07.584207 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.584173 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1842e1a9-c878-48f6-a65c-97d722626fbd-service-ca-bundle\") pod \"insights-operator-555d9d7885-x9kn9\" (UID: \"1842e1a9-c878-48f6-a65c-97d722626fbd\") " pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.584207 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.584197 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1842e1a9-c878-48f6-a65c-97d722626fbd-snapshots\") pod \"insights-operator-555d9d7885-x9kn9\" (UID: \"1842e1a9-c878-48f6-a65c-97d722626fbd\") " pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.584399 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.584378 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1842e1a9-c878-48f6-a65c-97d722626fbd-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-x9kn9\" (UID: \"1842e1a9-c878-48f6-a65c-97d722626fbd\") " pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.584458 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.584434 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-trusted-ca\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.584458 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.584448 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8cdcab86-40b1-4f9f-b6cb-d95773289927-trusted-ca\") pod \"console-operator-565b7b569d-mx9vm\" (UID: \"8cdcab86-40b1-4f9f-b6cb-d95773289927\") " pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" Jul 16 22:18:07.584562 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.584484 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-t7slq\" (UID: \"5b5980c2-7b9e-4074-bfef-4ac10d58cd34\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq" Jul 16 22:18:07.584620 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:07.584563 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 22:18:07.584620 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:07.584612 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-cluster-monitoring-operator-tls podName:5b5980c2-7b9e-4074-bfef-4ac10d58cd34 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:08.084598676 +0000 UTC m=+254.187243884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-t7slq" (UID: "5b5980c2-7b9e-4074-bfef-4ac10d58cd34") : secret "cluster-monitoring-operator-tls" not found Jul 16 22:18:07.584732 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.584629 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1842e1a9-c878-48f6-a65c-97d722626fbd-serving-cert\") pod \"insights-operator-555d9d7885-x9kn9\" (UID: \"1842e1a9-c878-48f6-a65c-97d722626fbd\") " pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.584732 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.584648 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8cdcab86-40b1-4f9f-b6cb-d95773289927-serving-cert\") pod \"console-operator-565b7b569d-mx9vm\" (UID: \"8cdcab86-40b1-4f9f-b6cb-d95773289927\") " pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" Jul 16 22:18:07.584732 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.584672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm5gl\" (UniqueName: \"kubernetes.io/projected/8cdcab86-40b1-4f9f-b6cb-d95773289927-kube-api-access-fm5gl\") pod \"console-operator-565b7b569d-mx9vm\" (UID: \"8cdcab86-40b1-4f9f-b6cb-d95773289927\") " pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" Jul 16 22:18:07.584732 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.584669 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1842e1a9-c878-48f6-a65c-97d722626fbd-tmp\") pod \"insights-operator-555d9d7885-x9kn9\" (UID: \"1842e1a9-c878-48f6-a65c-97d722626fbd\") " pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.584926 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.584731 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-installation-pull-secrets\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.584926 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.584766 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-image-registry-private-configuration\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.586924 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.586901 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1842e1a9-c878-48f6-a65c-97d722626fbd-serving-cert\") pod \"insights-operator-555d9d7885-x9kn9\" (UID: \"1842e1a9-c878-48f6-a65c-97d722626fbd\") " pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.587019 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.586951 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8cdcab86-40b1-4f9f-b6cb-d95773289927-serving-cert\") pod \"console-operator-565b7b569d-mx9vm\" (UID: \"8cdcab86-40b1-4f9f-b6cb-d95773289927\") " pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" Jul 16 22:18:07.597301 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.597273 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7zvs\" (UniqueName: \"kubernetes.io/projected/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-kube-api-access-z7zvs\") pod \"cluster-monitoring-operator-76cf8966f8-t7slq\" (UID: \"5b5980c2-7b9e-4074-bfef-4ac10d58cd34\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq" Jul 16 22:18:07.597417 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.597304 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fd8g\" (UniqueName: \"kubernetes.io/projected/1842e1a9-c878-48f6-a65c-97d722626fbd-kube-api-access-5fd8g\") pod \"insights-operator-555d9d7885-x9kn9\" (UID: \"1842e1a9-c878-48f6-a65c-97d722626fbd\") " pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.600847 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.600827 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm5gl\" (UniqueName: \"kubernetes.io/projected/8cdcab86-40b1-4f9f-b6cb-d95773289927-kube-api-access-fm5gl\") pod \"console-operator-565b7b569d-mx9vm\" (UID: \"8cdcab86-40b1-4f9f-b6cb-d95773289927\") " pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" Jul 16 22:18:07.686001 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.685906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cttxb\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-kube-api-access-cttxb\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.686001 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.685946 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-bound-sa-token\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.686001 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.685963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.686001 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.685978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-trusted-ca\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.686366 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.686015 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-installation-pull-secrets\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.686366 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.686032 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-image-registry-private-configuration\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.686366 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.686065 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-certificates\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.686366 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:07.686111 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 22:18:07.686366 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.686138 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-ca-trust-extracted\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.686366 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:07.686148 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d47db56d-wvf5f: secret "image-registry-tls" not found Jul 16 22:18:07.686366 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.686163 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wczv7\" (UniqueName: \"kubernetes.io/projected/0d290bb5-df48-4edf-b1fb-44e4d2547663-kube-api-access-wczv7\") pod \"network-check-source-7bc5b6bf85-qjbft\" (UID: \"0d290bb5-df48-4edf-b1fb-44e4d2547663\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-qjbft" Jul 16 22:18:07.686366 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:07.686215 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls podName:d4c9f17a-defc-42e8-8f0c-fb7f29a93375 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:08.186196593 +0000 UTC m=+254.288841796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls") pod "image-registry-d47db56d-wvf5f" (UID: "d4c9f17a-defc-42e8-8f0c-fb7f29a93375") : secret "image-registry-tls" not found Jul 16 22:18:07.686680 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.686658 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-ca-trust-extracted\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.686839 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.686815 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-certificates\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.687044 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.687025 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-trusted-ca\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.688540 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.688523 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-installation-pull-secrets\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.688601 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.688547 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-image-registry-private-configuration\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.694533 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.694514 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-x9kn9" Jul 16 22:18:07.696454 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.696430 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cttxb\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-kube-api-access-cttxb\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.696978 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.696953 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-bound-sa-token\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:07.697519 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.697184 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wczv7\" (UniqueName: \"kubernetes.io/projected/0d290bb5-df48-4edf-b1fb-44e4d2547663-kube-api-access-wczv7\") pod \"network-check-source-7bc5b6bf85-qjbft\" (UID: \"0d290bb5-df48-4edf-b1fb-44e4d2547663\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-qjbft" Jul 16 22:18:07.701128 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.701109 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" Jul 16 22:18:07.777189 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.777065 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-qjbft" Jul 16 22:18:07.835926 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.835863 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-x9kn9"] Jul 16 22:18:07.839574 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:18:07.839539 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1842e1a9_c878_48f6_a65c_97d722626fbd.slice/crio-d69e1de68027766209130e10d372742b682a2f07da0ed582cada6710b74727f5 WatchSource:0}: Error finding container d69e1de68027766209130e10d372742b682a2f07da0ed582cada6710b74727f5: Status 404 returned error can't find the container with id d69e1de68027766209130e10d372742b682a2f07da0ed582cada6710b74727f5 Jul 16 22:18:07.852318 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.852295 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-mx9vm"] Jul 16 22:18:07.854823 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:18:07.854796 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cdcab86_40b1_4f9f_b6cb_d95773289927.slice/crio-428bc35ab242e8d6dec36179e9c589533e1ab784cac2562df7ecb42cf7be15b3 WatchSource:0}: Error finding container 428bc35ab242e8d6dec36179e9c589533e1ab784cac2562df7ecb42cf7be15b3: Status 404 returned error can't find the container with id 428bc35ab242e8d6dec36179e9c589533e1ab784cac2562df7ecb42cf7be15b3 Jul 16 22:18:07.909385 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:07.909361 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-qjbft"] Jul 16 22:18:07.911593 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:18:07.911566 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d290bb5_df48_4edf_b1fb_44e4d2547663.slice/crio-d04f84bd0c45d55ee4d66f4c9953a59763194836389cce78bbf2371cbce11229 WatchSource:0}: Error finding container d04f84bd0c45d55ee4d66f4c9953a59763194836389cce78bbf2371cbce11229: Status 404 returned error can't find the container with id d04f84bd0c45d55ee4d66f4c9953a59763194836389cce78bbf2371cbce11229 Jul 16 22:18:08.089406 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:08.089362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-t7slq\" (UID: \"5b5980c2-7b9e-4074-bfef-4ac10d58cd34\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq" Jul 16 22:18:08.089592 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:08.089530 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 22:18:08.089655 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:08.089605 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-cluster-monitoring-operator-tls podName:5b5980c2-7b9e-4074-bfef-4ac10d58cd34 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:09.089585493 +0000 UTC m=+255.192230713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-t7slq" (UID: "5b5980c2-7b9e-4074-bfef-4ac10d58cd34") : secret "cluster-monitoring-operator-tls" not found Jul 16 22:18:08.190201 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:08.190130 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:08.190337 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:08.190256 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 22:18:08.190337 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:08.190269 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d47db56d-wvf5f: secret "image-registry-tls" not found Jul 16 22:18:08.190337 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:08.190316 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls podName:d4c9f17a-defc-42e8-8f0c-fb7f29a93375 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:09.190300495 +0000 UTC m=+255.292945701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls") pod "image-registry-d47db56d-wvf5f" (UID: "d4c9f17a-defc-42e8-8f0c-fb7f29a93375") : secret "image-registry-tls" not found Jul 16 22:18:08.225126 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:08.225093 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" event={"ID":"8cdcab86-40b1-4f9f-b6cb-d95773289927","Type":"ContainerStarted","Data":"428bc35ab242e8d6dec36179e9c589533e1ab784cac2562df7ecb42cf7be15b3"} Jul 16 22:18:08.226542 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:08.226509 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-x9kn9" event={"ID":"1842e1a9-c878-48f6-a65c-97d722626fbd","Type":"ContainerStarted","Data":"d69e1de68027766209130e10d372742b682a2f07da0ed582cada6710b74727f5"} Jul 16 22:18:08.228208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:08.228184 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-qjbft" event={"ID":"0d290bb5-df48-4edf-b1fb-44e4d2547663","Type":"ContainerStarted","Data":"6a9d8b044a273ac94567a7e458e8b367d4068795def3e0cc88d15714947b2c0e"} Jul 16 22:18:08.228338 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:08.228225 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-qjbft" event={"ID":"0d290bb5-df48-4edf-b1fb-44e4d2547663","Type":"ContainerStarted","Data":"d04f84bd0c45d55ee4d66f4c9953a59763194836389cce78bbf2371cbce11229"} Jul 16 22:18:09.096343 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:09.096296 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-t7slq\" (UID: \"5b5980c2-7b9e-4074-bfef-4ac10d58cd34\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq" Jul 16 22:18:09.096725 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:09.096428 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 22:18:09.096725 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:09.096482 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-cluster-monitoring-operator-tls podName:5b5980c2-7b9e-4074-bfef-4ac10d58cd34 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:11.096467705 +0000 UTC m=+257.199112909 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-t7slq" (UID: "5b5980c2-7b9e-4074-bfef-4ac10d58cd34") : secret "cluster-monitoring-operator-tls" not found Jul 16 22:18:09.197607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:09.197568 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:09.197878 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:09.197754 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 22:18:09.197878 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:09.197780 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d47db56d-wvf5f: secret "image-registry-tls" not found Jul 16 22:18:09.197878 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:09.197848 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls podName:d4c9f17a-defc-42e8-8f0c-fb7f29a93375 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:11.19782853 +0000 UTC m=+257.300473739 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls") pod "image-registry-d47db56d-wvf5f" (UID: "d4c9f17a-defc-42e8-8f0c-fb7f29a93375") : secret "image-registry-tls" not found Jul 16 22:18:10.236348 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:10.236305 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-x9kn9" event={"ID":"1842e1a9-c878-48f6-a65c-97d722626fbd","Type":"ContainerStarted","Data":"060e433e6939c8acae0b312d4f2517304161d7430754dc86e774de392fc38420"} Jul 16 22:18:10.237977 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:10.237946 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" event={"ID":"8cdcab86-40b1-4f9f-b6cb-d95773289927","Type":"ContainerStarted","Data":"262dbb385d09e7c41acb621088add8ad53cbccc5051b1780334c7f6d741425d2"} Jul 16 22:18:10.238696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:10.238186 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" Jul 16 22:18:10.239764 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:10.239735 2578 patch_prober.go:28] interesting pod/console-operator-565b7b569d-mx9vm container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.9:8443/readyz\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body= Jul 16 22:18:10.239914 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:10.239786 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" podUID="8cdcab86-40b1-4f9f-b6cb-d95773289927" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.9:8443/readyz\": dial tcp 10.134.0.9:8443: connect: connection refused" Jul 16 22:18:10.256932 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:10.256882 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-qjbft" podStartSLOduration=3.256870408 podStartE2EDuration="3.256870408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:18:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:08.244718684 +0000 UTC m=+254.347363912" watchObservedRunningTime="2026-07-16 22:18:10.256870408 +0000 UTC m=+256.359515634" Jul 16 22:18:10.257369 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:10.257344 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-x9kn9" podStartSLOduration=0.972494124 podStartE2EDuration="3.257337307s" totalImagesPullingTime="2.284843183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:10.256615345 +0000 UTC m=+256.359260584" watchObservedRunningTime="2026-07-16 22:18:10.257337307 +0000 UTC m=+256.359982532" Jul 16 22:18:10.277270 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:10.277231 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" podStartSLOduration=1.006990707 podStartE2EDuration="3.27721627s" totalImagesPullingTime="2.270225563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:10.276547536 +0000 UTC m=+256.379192762" watchObservedRunningTime="2026-07-16 22:18:10.27721627 +0000 UTC m=+256.379861496" Jul 16 22:18:11.115809 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.115772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-t7slq\" (UID: \"5b5980c2-7b9e-4074-bfef-4ac10d58cd34\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq" Jul 16 22:18:11.115992 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:11.115927 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 22:18:11.116037 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:11.115994 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-cluster-monitoring-operator-tls podName:5b5980c2-7b9e-4074-bfef-4ac10d58cd34 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:15.115977378 +0000 UTC m=+261.218622584 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-t7slq" (UID: "5b5980c2-7b9e-4074-bfef-4ac10d58cd34") : secret "cluster-monitoring-operator-tls" not found Jul 16 22:18:11.216410 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.216356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:11.216544 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:11.216502 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 22:18:11.216544 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:11.216521 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d47db56d-wvf5f: secret "image-registry-tls" not found Jul 16 22:18:11.216646 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:11.216569 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls podName:d4c9f17a-defc-42e8-8f0c-fb7f29a93375 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:15.216554901 +0000 UTC m=+261.319200104 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls") pod "image-registry-d47db56d-wvf5f" (UID: "d4c9f17a-defc-42e8-8f0c-fb7f29a93375") : secret "image-registry-tls" not found Jul 16 22:18:11.242038 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.242016 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/0.log" Jul 16 22:18:11.242482 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.242050 2578 generic.go:356] "Generic (PLEG): container finished" podID="8cdcab86-40b1-4f9f-b6cb-d95773289927" containerID="262dbb385d09e7c41acb621088add8ad53cbccc5051b1780334c7f6d741425d2" exitCode=255 Jul 16 22:18:11.242482 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.242099 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" event={"ID":"8cdcab86-40b1-4f9f-b6cb-d95773289927","Type":"ContainerDied","Data":"262dbb385d09e7c41acb621088add8ad53cbccc5051b1780334c7f6d741425d2"} Jul 16 22:18:11.242482 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.242397 2578 scope.go:117] "RemoveContainer" containerID="262dbb385d09e7c41acb621088add8ad53cbccc5051b1780334c7f6d741425d2" Jul 16 22:18:11.464905 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.464875 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8gwwg"] Jul 16 22:18:11.467133 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.467117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:11.472684 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.472665 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 22:18:11.472859 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.472818 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 22:18:11.472941 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.472867 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5nldq\"" Jul 16 22:18:11.480922 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.480897 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8gwwg"] Jul 16 22:18:11.618595 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.618553 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/043789bd-6346-4456-b51f-714faa785b55-crio-socket\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:11.618789 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.618601 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l62kn\" (UniqueName: \"kubernetes.io/projected/043789bd-6346-4456-b51f-714faa785b55-kube-api-access-l62kn\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:11.618789 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.618697 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/043789bd-6346-4456-b51f-714faa785b55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:11.618789 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.618739 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/043789bd-6346-4456-b51f-714faa785b55-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:11.618789 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.618767 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/043789bd-6346-4456-b51f-714faa785b55-data-volume\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:11.719134 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.719038 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/043789bd-6346-4456-b51f-714faa785b55-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:11.719134 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.719107 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/043789bd-6346-4456-b51f-714faa785b55-data-volume\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:11.719317 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.719162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/043789bd-6346-4456-b51f-714faa785b55-crio-socket\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:11.719317 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:11.719165 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 22:18:11.719317 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.719191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l62kn\" (UniqueName: \"kubernetes.io/projected/043789bd-6346-4456-b51f-714faa785b55-kube-api-access-l62kn\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:11.719317 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:11.719237 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/043789bd-6346-4456-b51f-714faa785b55-kube-rbac-proxy-cm podName:043789bd-6346-4456-b51f-714faa785b55 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:12.219218487 +0000 UTC m=+258.321863714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/043789bd-6346-4456-b51f-714faa785b55-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8gwwg" (UID: "043789bd-6346-4456-b51f-714faa785b55") : configmap "kube-rbac-proxy" not found Jul 16 22:18:11.719317 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.719252 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/043789bd-6346-4456-b51f-714faa785b55-crio-socket\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:11.719474 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.719319 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/043789bd-6346-4456-b51f-714faa785b55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:11.719474 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:11.719407 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 22:18:11.719474 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:11.719448 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/043789bd-6346-4456-b51f-714faa785b55-insights-runtime-extractor-tls podName:043789bd-6346-4456-b51f-714faa785b55 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:12.219435433 +0000 UTC m=+258.322080637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/043789bd-6346-4456-b51f-714faa785b55-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8gwwg" (UID: "043789bd-6346-4456-b51f-714faa785b55") : secret "insights-runtime-extractor-tls" not found Jul 16 22:18:11.719570 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.719485 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/043789bd-6346-4456-b51f-714faa785b55-data-volume\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:11.727617 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:11.727591 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l62kn\" (UniqueName: \"kubernetes.io/projected/043789bd-6346-4456-b51f-714faa785b55-kube-api-access-l62kn\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:12.222669 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:12.222636 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/043789bd-6346-4456-b51f-714faa785b55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:12.222858 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:12.222676 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/043789bd-6346-4456-b51f-714faa785b55-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:12.222858 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:12.222806 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 22:18:12.222969 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:12.222881 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/043789bd-6346-4456-b51f-714faa785b55-insights-runtime-extractor-tls podName:043789bd-6346-4456-b51f-714faa785b55 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:13.222858806 +0000 UTC m=+259.325504010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/043789bd-6346-4456-b51f-714faa785b55-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8gwwg" (UID: "043789bd-6346-4456-b51f-714faa785b55") : secret "insights-runtime-extractor-tls" not found Jul 16 22:18:12.222969 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:12.222819 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 22:18:12.222969 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:12.222944 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/043789bd-6346-4456-b51f-714faa785b55-kube-rbac-proxy-cm podName:043789bd-6346-4456-b51f-714faa785b55 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:13.222932277 +0000 UTC m=+259.325577486 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/043789bd-6346-4456-b51f-714faa785b55-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8gwwg" (UID: "043789bd-6346-4456-b51f-714faa785b55") : configmap "kube-rbac-proxy" not found Jul 16 22:18:12.247040 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:12.247019 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:18:12.247493 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:12.247476 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/0.log" Jul 16 22:18:12.247545 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:12.247515 2578 generic.go:356] "Generic (PLEG): container finished" podID="8cdcab86-40b1-4f9f-b6cb-d95773289927" containerID="376f5690b3a668c5ffa7fa541008e7728acd3efd4303457060f7ed3949ecbda7" exitCode=255 Jul 16 22:18:12.247583 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:12.247556 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" event={"ID":"8cdcab86-40b1-4f9f-b6cb-d95773289927","Type":"ContainerDied","Data":"376f5690b3a668c5ffa7fa541008e7728acd3efd4303457060f7ed3949ecbda7"} Jul 16 22:18:12.247625 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:12.247608 2578 scope.go:117] "RemoveContainer" containerID="262dbb385d09e7c41acb621088add8ad53cbccc5051b1780334c7f6d741425d2" Jul 16 22:18:12.247837 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:12.247822 2578 scope.go:117] "RemoveContainer" containerID="376f5690b3a668c5ffa7fa541008e7728acd3efd4303457060f7ed3949ecbda7" Jul 16 22:18:12.248008 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:12.247983 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-mx9vm_openshift-console-operator(8cdcab86-40b1-4f9f-b6cb-d95773289927)\"" pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" podUID="8cdcab86-40b1-4f9f-b6cb-d95773289927" Jul 16 22:18:13.230297 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:13.230261 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/043789bd-6346-4456-b51f-714faa785b55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:13.230297 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:13.230302 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/043789bd-6346-4456-b51f-714faa785b55-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:13.230509 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:13.230387 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 22:18:13.230509 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:13.230418 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 22:18:13.230509 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:13.230443 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/043789bd-6346-4456-b51f-714faa785b55-kube-rbac-proxy-cm podName:043789bd-6346-4456-b51f-714faa785b55 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:15.230428422 +0000 UTC m=+261.333073627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/043789bd-6346-4456-b51f-714faa785b55-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8gwwg" (UID: "043789bd-6346-4456-b51f-714faa785b55") : configmap "kube-rbac-proxy" not found Jul 16 22:18:13.230509 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:13.230473 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/043789bd-6346-4456-b51f-714faa785b55-insights-runtime-extractor-tls podName:043789bd-6346-4456-b51f-714faa785b55 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:15.230459677 +0000 UTC m=+261.333104880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/043789bd-6346-4456-b51f-714faa785b55-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8gwwg" (UID: "043789bd-6346-4456-b51f-714faa785b55") : secret "insights-runtime-extractor-tls" not found Jul 16 22:18:13.251678 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:13.251656 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:18:13.252135 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:13.252036 2578 scope.go:117] "RemoveContainer" containerID="376f5690b3a668c5ffa7fa541008e7728acd3efd4303457060f7ed3949ecbda7" Jul 16 22:18:13.252247 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:13.252225 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-mx9vm_openshift-console-operator(8cdcab86-40b1-4f9f-b6cb-d95773289927)\"" pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" podUID="8cdcab86-40b1-4f9f-b6cb-d95773289927" Jul 16 22:18:13.676624 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:13.676553 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sktxq_79fde428-77a9-46c5-8239-73be6e3df2c8/dns-node-resolver/0.log" Jul 16 22:18:14.277343 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:14.277320 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-48dtb_d01020ff-0f0b-4e2a-b9a3-921a789917f6/node-ca/0.log" Jul 16 22:18:15.145595 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:15.145563 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-t7slq\" (UID: \"5b5980c2-7b9e-4074-bfef-4ac10d58cd34\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq" Jul 16 22:18:15.145764 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:15.145705 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 22:18:15.145810 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:15.145764 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-cluster-monitoring-operator-tls podName:5b5980c2-7b9e-4074-bfef-4ac10d58cd34 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:23.145750334 +0000 UTC m=+269.248395538 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-t7slq" (UID: "5b5980c2-7b9e-4074-bfef-4ac10d58cd34") : secret "cluster-monitoring-operator-tls" not found Jul 16 22:18:15.246711 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:15.246677 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:15.246839 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:15.246731 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/043789bd-6346-4456-b51f-714faa785b55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:15.246839 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:15.246765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/043789bd-6346-4456-b51f-714faa785b55-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:15.246971 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:15.246849 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 22:18:15.246971 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:15.246901 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/043789bd-6346-4456-b51f-714faa785b55-kube-rbac-proxy-cm podName:043789bd-6346-4456-b51f-714faa785b55 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:19.246888141 +0000 UTC m=+265.349533345 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/043789bd-6346-4456-b51f-714faa785b55-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8gwwg" (UID: "043789bd-6346-4456-b51f-714faa785b55") : configmap "kube-rbac-proxy" not found Jul 16 22:18:15.246971 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:15.246920 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 22:18:15.247106 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:15.246986 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/043789bd-6346-4456-b51f-714faa785b55-insights-runtime-extractor-tls podName:043789bd-6346-4456-b51f-714faa785b55 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:19.24696836 +0000 UTC m=+265.349613578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/043789bd-6346-4456-b51f-714faa785b55-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8gwwg" (UID: "043789bd-6346-4456-b51f-714faa785b55") : secret "insights-runtime-extractor-tls" not found Jul 16 22:18:15.247106 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:15.246851 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 22:18:15.247106 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:15.247015 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d47db56d-wvf5f: secret "image-registry-tls" not found Jul 16 22:18:15.247106 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:15.247056 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls podName:d4c9f17a-defc-42e8-8f0c-fb7f29a93375 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:23.247044246 +0000 UTC m=+269.349689470 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls") pod "image-registry-d47db56d-wvf5f" (UID: "d4c9f17a-defc-42e8-8f0c-fb7f29a93375") : secret "image-registry-tls" not found Jul 16 22:18:15.479745 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:15.479714 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w89ct_b1a73a64-eee7-4065-9598-d8079291529a/serve-healthcheck-canary/0.log" Jul 16 22:18:17.701655 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:17.701625 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" Jul 16 22:18:17.701996 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:17.701953 2578 scope.go:117] "RemoveContainer" containerID="376f5690b3a668c5ffa7fa541008e7728acd3efd4303457060f7ed3949ecbda7" Jul 16 22:18:17.702162 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:17.702142 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-mx9vm_openshift-console-operator(8cdcab86-40b1-4f9f-b6cb-d95773289927)\"" pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" podUID="8cdcab86-40b1-4f9f-b6cb-d95773289927" Jul 16 22:18:19.279356 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:19.279315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/043789bd-6346-4456-b51f-714faa785b55-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:19.279820 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:19.279442 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 22:18:19.279820 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:19.279456 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/043789bd-6346-4456-b51f-714faa785b55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:19.279820 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:19.279504 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/043789bd-6346-4456-b51f-714faa785b55-kube-rbac-proxy-cm podName:043789bd-6346-4456-b51f-714faa785b55 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:27.279489146 +0000 UTC m=+273.382134350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/043789bd-6346-4456-b51f-714faa785b55-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8gwwg" (UID: "043789bd-6346-4456-b51f-714faa785b55") : configmap "kube-rbac-proxy" not found Jul 16 22:18:19.279820 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:19.279578 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 22:18:19.279820 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:19.279637 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/043789bd-6346-4456-b51f-714faa785b55-insights-runtime-extractor-tls podName:043789bd-6346-4456-b51f-714faa785b55 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:27.279620726 +0000 UTC m=+273.382265930 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/043789bd-6346-4456-b51f-714faa785b55-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8gwwg" (UID: "043789bd-6346-4456-b51f-714faa785b55") : secret "insights-runtime-extractor-tls" not found Jul 16 22:18:20.238171 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:20.238137 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" Jul 16 22:18:20.238505 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:20.238491 2578 scope.go:117] "RemoveContainer" containerID="376f5690b3a668c5ffa7fa541008e7728acd3efd4303457060f7ed3949ecbda7" Jul 16 22:18:20.238657 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:20.238639 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-mx9vm_openshift-console-operator(8cdcab86-40b1-4f9f-b6cb-d95773289927)\"" pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" podUID="8cdcab86-40b1-4f9f-b6cb-d95773289927" Jul 16 22:18:23.212636 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:23.212605 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-t7slq\" (UID: \"5b5980c2-7b9e-4074-bfef-4ac10d58cd34\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq" Jul 16 22:18:23.214965 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:23.214946 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b5980c2-7b9e-4074-bfef-4ac10d58cd34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-t7slq\" (UID: \"5b5980c2-7b9e-4074-bfef-4ac10d58cd34\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq" Jul 16 22:18:23.306809 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:23.306777 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq" Jul 16 22:18:23.313829 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:23.313801 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:23.316220 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:23.316196 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls\") pod \"image-registry-d47db56d-wvf5f\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:23.381213 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:23.381184 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:23.437800 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:23.437770 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq"] Jul 16 22:18:23.441989 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:18:23.441737 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b5980c2_7b9e_4074_bfef_4ac10d58cd34.slice/crio-5d95843ba53573f80884dc7837daf507ca9cfd46e54cb57a34f7827f7f5a7b98 WatchSource:0}: Error finding container 5d95843ba53573f80884dc7837daf507ca9cfd46e54cb57a34f7827f7f5a7b98: Status 404 returned error can't find the container with id 5d95843ba53573f80884dc7837daf507ca9cfd46e54cb57a34f7827f7f5a7b98 Jul 16 22:18:23.508745 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:23.508674 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d47db56d-wvf5f"] Jul 16 22:18:23.511295 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:18:23.511268 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c9f17a_defc_42e8_8f0c_fb7f29a93375.slice/crio-14f409cf89c0c27834a3931b2a9b3383ae1cd6320a410b93a65f871100ee1b70 WatchSource:0}: Error finding container 14f409cf89c0c27834a3931b2a9b3383ae1cd6320a410b93a65f871100ee1b70: Status 404 returned error can't find the container with id 14f409cf89c0c27834a3931b2a9b3383ae1cd6320a410b93a65f871100ee1b70 Jul 16 22:18:24.286159 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:24.286121 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d47db56d-wvf5f" event={"ID":"d4c9f17a-defc-42e8-8f0c-fb7f29a93375","Type":"ContainerStarted","Data":"dc399898a2a0111068552fad0a35732e4680dad6aa9a75ddd6c838c086916191"} Jul 16 22:18:24.286638 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:24.286182 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d47db56d-wvf5f" event={"ID":"d4c9f17a-defc-42e8-8f0c-fb7f29a93375","Type":"ContainerStarted","Data":"14f409cf89c0c27834a3931b2a9b3383ae1cd6320a410b93a65f871100ee1b70"} Jul 16 22:18:24.286638 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:24.286207 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:24.287655 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:24.287625 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq" event={"ID":"5b5980c2-7b9e-4074-bfef-4ac10d58cd34","Type":"ContainerStarted","Data":"5d95843ba53573f80884dc7837daf507ca9cfd46e54cb57a34f7827f7f5a7b98"} Jul 16 22:18:24.308773 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:24.308709 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d47db56d-wvf5f" podStartSLOduration=17.308688637 podStartE2EDuration="17.308688637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:18:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:24.307035707 +0000 UTC m=+270.409680963" watchObservedRunningTime="2026-07-16 22:18:24.308688637 +0000 UTC m=+270.411333864" Jul 16 22:18:25.292023 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:25.291981 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq" event={"ID":"5b5980c2-7b9e-4074-bfef-4ac10d58cd34","Type":"ContainerStarted","Data":"5bf78f781abaf5fdbeaaad20a52454b7ebdb44c2f7979f566da8cbb89c6512d2"} Jul 16 22:18:25.309457 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:25.309399 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-t7slq" podStartSLOduration=16.620394523999998 podStartE2EDuration="18.309378393s" totalImagesPullingTime="1.688983869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:25.30687514 +0000 UTC m=+271.409520367" watchObservedRunningTime="2026-07-16 22:18:25.309378393 +0000 UTC m=+271.412023621" Jul 16 22:18:27.348026 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:27.347990 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/043789bd-6346-4456-b51f-714faa785b55-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:27.348508 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:27.348084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/043789bd-6346-4456-b51f-714faa785b55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:27.348551 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:27.348504 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/043789bd-6346-4456-b51f-714faa785b55-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:27.350242 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:27.350223 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/043789bd-6346-4456-b51f-714faa785b55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8gwwg\" (UID: \"043789bd-6346-4456-b51f-714faa785b55\") " pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:27.376260 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:27.376235 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8gwwg" Jul 16 22:18:27.497220 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:27.497189 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8gwwg"] Jul 16 22:18:27.499856 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:18:27.499827 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod043789bd_6346_4456_b51f_714faa785b55.slice/crio-90001a9d4562bd7becbe073573a3b91cc3ad6ad898346c316fd028c0c090f544 WatchSource:0}: Error finding container 90001a9d4562bd7becbe073573a3b91cc3ad6ad898346c316fd028c0c090f544: Status 404 returned error can't find the container with id 90001a9d4562bd7becbe073573a3b91cc3ad6ad898346c316fd028c0c090f544 Jul 16 22:18:28.302601 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:28.302562 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8gwwg" event={"ID":"043789bd-6346-4456-b51f-714faa785b55","Type":"ContainerStarted","Data":"90001a9d4562bd7becbe073573a3b91cc3ad6ad898346c316fd028c0c090f544"} Jul 16 22:18:33.322234 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:33.322171 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8gwwg" event={"ID":"043789bd-6346-4456-b51f-714faa785b55","Type":"ContainerStarted","Data":"64ec634daceae4b879bda37ab8af75ac2f4de4384f423a59b69b0dc4ce7d45d5"} Jul 16 22:18:34.426241 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:34.426214 2578 scope.go:117] "RemoveContainer" containerID="376f5690b3a668c5ffa7fa541008e7728acd3efd4303457060f7ed3949ecbda7" Jul 16 22:18:36.339479 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:36.339447 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:18:36.339928 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:36.339564 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" event={"ID":"8cdcab86-40b1-4f9f-b6cb-d95773289927","Type":"ContainerStarted","Data":"b85fcff5dd2d88a4f17b9918c8509eba17103cc87c47327fc1a111e2965eda9f"} Jul 16 22:18:36.339928 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:36.339898 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" Jul 16 22:18:36.341495 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:36.341474 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8gwwg" event={"ID":"043789bd-6346-4456-b51f-714faa785b55","Type":"ContainerStarted","Data":"77bf62e912603bebe608b8722c41ca3c632bade48f82ad1097f1830b564b4484"} Jul 16 22:18:36.460405 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:36.460375 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-mx9vm" Jul 16 22:18:37.008464 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:37.008425 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tsh7f" podUID="d63ed4f5-feea-48bd-ab8b-c7249e46501b" Jul 16 22:18:37.344422 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:37.344351 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tsh7f" Jul 16 22:18:37.892413 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:37.892373 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d47db56d-wvf5f"] Jul 16 22:18:37.960720 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:37.960682 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-bm4xf"] Jul 16 22:18:37.963651 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:37.963631 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-d75pn"] Jul 16 22:18:37.963789 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:37.963769 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-bm4xf" Jul 16 22:18:37.966424 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:37.966402 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d449d7d49-lqpdh"] Jul 16 22:18:37.966549 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:37.966500 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kjb6q\"" Jul 16 22:18:37.966549 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:37.966533 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-d75pn" Jul 16 22:18:37.967838 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:37.967819 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 22:18:37.967938 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:37.967840 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 22:18:37.969378 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:37.969362 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:37.971328 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:37.971303 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zc4wp\"" Jul 16 22:18:37.971446 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:37.971420 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 16 22:18:37.981495 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:37.981475 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-bm4xf"] Jul 16 22:18:37.985578 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:37.985555 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-d75pn"] Jul 16 22:18:37.996932 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:37.996902 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d449d7d49-lqpdh"] Jul 16 22:18:38.031285 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.031257 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-registry-certificates\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.031428 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.031297 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-897hf\" (UniqueName: \"kubernetes.io/projected/64615f5e-5127-4c4a-9e3a-1f4562baabf5-kube-api-access-897hf\") pod \"downloads-5bc67dcd46-bm4xf\" (UID: \"64615f5e-5127-4c4a-9e3a-1f4562baabf5\") " pod="openshift-console/downloads-5bc67dcd46-bm4xf" Jul 16 22:18:38.031428 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.031321 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-ca-trust-extracted\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.031428 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.031346 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/172dd88f-b709-47a1-9083-9fe60bc22fea-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-d75pn\" (UID: \"172dd88f-b709-47a1-9083-9fe60bc22fea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-d75pn" Jul 16 22:18:38.031428 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.031372 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-trusted-ca\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.031630 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.031445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-image-registry-private-configuration\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.031630 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.031462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-installation-pull-secrets\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.031630 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.031479 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-bound-sa-token\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.031630 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.031500 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-registry-tls\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.031630 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.031523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xblmr\" (UniqueName: \"kubernetes.io/projected/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-kube-api-access-xblmr\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.132843 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.132812 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-registry-certificates\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.133011 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.132860 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-897hf\" (UniqueName: \"kubernetes.io/projected/64615f5e-5127-4c4a-9e3a-1f4562baabf5-kube-api-access-897hf\") pod \"downloads-5bc67dcd46-bm4xf\" (UID: \"64615f5e-5127-4c4a-9e3a-1f4562baabf5\") " pod="openshift-console/downloads-5bc67dcd46-bm4xf" Jul 16 22:18:38.133011 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.132887 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-ca-trust-extracted\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.133011 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.132911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/172dd88f-b709-47a1-9083-9fe60bc22fea-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-d75pn\" (UID: \"172dd88f-b709-47a1-9083-9fe60bc22fea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-d75pn" Jul 16 22:18:38.133011 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.132942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-trusted-ca\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.133011 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.133005 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-image-registry-private-configuration\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.133307 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.133029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-installation-pull-secrets\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.133307 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.133057 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-bound-sa-token\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.133307 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.133109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-registry-tls\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.133307 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.133136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xblmr\" (UniqueName: \"kubernetes.io/projected/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-kube-api-access-xblmr\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.133785 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.133735 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-ca-trust-extracted\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.133916 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.133847 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-registry-certificates\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.134535 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.134507 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-trusted-ca\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.135861 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.135799 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/172dd88f-b709-47a1-9083-9fe60bc22fea-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-d75pn\" (UID: \"172dd88f-b709-47a1-9083-9fe60bc22fea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-d75pn" Jul 16 22:18:38.136168 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.136140 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-registry-tls\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.136267 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.136185 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-installation-pull-secrets\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.136333 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.136317 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-image-registry-private-configuration\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.150062 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.149993 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-bound-sa-token\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.150244 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.150220 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xblmr\" (UniqueName: \"kubernetes.io/projected/baef0f9d-77ac-432b-a7b3-44a7a9e2f560-kube-api-access-xblmr\") pod \"image-registry-d449d7d49-lqpdh\" (UID: \"baef0f9d-77ac-432b-a7b3-44a7a9e2f560\") " pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:38.150488 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.150468 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-897hf\" (UniqueName: \"kubernetes.io/projected/64615f5e-5127-4c4a-9e3a-1f4562baabf5-kube-api-access-897hf\") pod \"downloads-5bc67dcd46-bm4xf\" (UID: \"64615f5e-5127-4c4a-9e3a-1f4562baabf5\") " pod="openshift-console/downloads-5bc67dcd46-bm4xf" Jul 16 22:18:38.274870 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.274836 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-bm4xf" Jul 16 22:18:38.283762 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.283739 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-d75pn" Jul 16 22:18:38.289374 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:38.289309 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:39.781713 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:39.781582 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d449d7d49-lqpdh"] Jul 16 22:18:39.784277 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:18:39.784252 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaef0f9d_77ac_432b_a7b3_44a7a9e2f560.slice/crio-13b31d91d05ca3b343c8550f17fbc7050a5e2e8ca60a19fd984bb87d950b81f8 WatchSource:0}: Error finding container 13b31d91d05ca3b343c8550f17fbc7050a5e2e8ca60a19fd984bb87d950b81f8: Status 404 returned error can't find the container with id 13b31d91d05ca3b343c8550f17fbc7050a5e2e8ca60a19fd984bb87d950b81f8 Jul 16 22:18:40.007921 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:40.003647 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-d75pn"] Jul 16 22:18:40.011117 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:40.011087 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-bm4xf"] Jul 16 22:18:40.012031 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:18:40.011999 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64615f5e_5127_4c4a_9e3a_1f4562baabf5.slice/crio-f5e92926673e7e51ee18815ce1048798cebc2cc7d060b713bd787c38743f181f WatchSource:0}: Error finding container f5e92926673e7e51ee18815ce1048798cebc2cc7d060b713bd787c38743f181f: Status 404 returned error can't find the container with id f5e92926673e7e51ee18815ce1048798cebc2cc7d060b713bd787c38743f181f Jul 16 22:18:40.250966 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:40.250931 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:18:40.253207 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:40.253164 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d63ed4f5-feea-48bd-ab8b-c7249e46501b-metrics-tls\") pod \"dns-default-tsh7f\" (UID: \"d63ed4f5-feea-48bd-ab8b-c7249e46501b\") " pod="openshift-dns/dns-default-tsh7f" Jul 16 22:18:40.347722 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:40.347693 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gpmss\"" Jul 16 22:18:40.354951 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:40.354926 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tsh7f" Jul 16 22:18:40.356747 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:40.356719 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-bm4xf" event={"ID":"64615f5e-5127-4c4a-9e3a-1f4562baabf5","Type":"ContainerStarted","Data":"f5e92926673e7e51ee18815ce1048798cebc2cc7d060b713bd787c38743f181f"} Jul 16 22:18:40.358841 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:40.358812 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8gwwg" event={"ID":"043789bd-6346-4456-b51f-714faa785b55","Type":"ContainerStarted","Data":"41cf3e8786d0d2de3dde8b7270cb838a7d6ddd6cc477c1b3b427edc4daa0ae83"} Jul 16 22:18:40.360191 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:40.360168 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" event={"ID":"baef0f9d-77ac-432b-a7b3-44a7a9e2f560","Type":"ContainerStarted","Data":"da61297d04a89226f4bdbd4b0cd429300ed71a3105241b1882b209c1297b5cad"} Jul 16 22:18:40.360283 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:40.360206 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" event={"ID":"baef0f9d-77ac-432b-a7b3-44a7a9e2f560","Type":"ContainerStarted","Data":"13b31d91d05ca3b343c8550f17fbc7050a5e2e8ca60a19fd984bb87d950b81f8"} Jul 16 22:18:40.360283 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:40.360230 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:18:40.361244 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:40.361219 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-d75pn" event={"ID":"172dd88f-b709-47a1-9083-9fe60bc22fea","Type":"ContainerStarted","Data":"b0e5e56b93ba37fceac59704cbed0b2a05a75cdbd78057015880806a13cc64d0"} Jul 16 22:18:40.379604 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:40.379558 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8gwwg" podStartSLOduration=17.332994475 podStartE2EDuration="29.37954294s" totalImagesPullingTime="12.046548465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:18:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:40.377867713 +0000 UTC m=+286.480512959" watchObservedRunningTime="2026-07-16 22:18:40.37954294 +0000 UTC m=+286.482188166" Jul 16 22:18:40.399274 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:40.399225 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" podStartSLOduration=3.399209597 podStartE2EDuration="3.399209597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:18:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:40.39798257 +0000 UTC m=+286.500627797" watchObservedRunningTime="2026-07-16 22:18:40.399209597 +0000 UTC m=+286.501854823" Jul 16 22:18:40.477901 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:40.477872 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tsh7f"] Jul 16 22:18:40.480834 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:18:40.480809 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd63ed4f5_feea_48bd_ab8b_c7249e46501b.slice/crio-0b9d5418d760ecfebdff03a9bb26553f3ab9fa743e29ea369157a551ba07115e WatchSource:0}: Error finding container 0b9d5418d760ecfebdff03a9bb26553f3ab9fa743e29ea369157a551ba07115e: Status 404 returned error can't find the container with id 0b9d5418d760ecfebdff03a9bb26553f3ab9fa743e29ea369157a551ba07115e Jul 16 22:18:41.368185 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.368044 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-d75pn" event={"ID":"172dd88f-b709-47a1-9083-9fe60bc22fea","Type":"ContainerStarted","Data":"c3d5cc06c3c22d882fc9cef6d28d6a2ac9f51213078e4b442459d1917fc9859c"} Jul 16 22:18:41.368625 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.368513 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-d75pn" Jul 16 22:18:41.369606 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.369536 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tsh7f" event={"ID":"d63ed4f5-feea-48bd-ab8b-c7249e46501b","Type":"ContainerStarted","Data":"0b9d5418d760ecfebdff03a9bb26553f3ab9fa743e29ea369157a551ba07115e"} Jul 16 22:18:41.374809 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.374781 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-d75pn" Jul 16 22:18:41.388368 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.388312 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-d75pn" podStartSLOduration=3.331986035 podStartE2EDuration="4.388291251s" totalImagesPullingTime="1.056305216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:41.387517633 +0000 UTC m=+287.490162886" watchObservedRunningTime="2026-07-16 22:18:41.388291251 +0000 UTC m=+287.490936480" Jul 16 22:18:41.682262 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.682178 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-rr85x"] Jul 16 22:18:41.685692 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.685668 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-rr85x" Jul 16 22:18:41.689088 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.688873 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 16 22:18:41.689409 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.689360 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 16 22:18:41.690526 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.690461 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 22:18:41.690621 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.690570 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-sntcl\"" Jul 16 22:18:41.698582 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.698522 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-rr85x"] Jul 16 22:18:41.762967 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.762932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz6lk\" (UniqueName: \"kubernetes.io/projected/5272c9e2-42e5-4233-bec5-742436d7b47a-kube-api-access-cz6lk\") pod \"prometheus-operator-5945b5cfd-rr85x\" (UID: \"5272c9e2-42e5-4233-bec5-742436d7b47a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rr85x" Jul 16 22:18:41.763170 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.763034 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5272c9e2-42e5-4233-bec5-742436d7b47a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-rr85x\" (UID: \"5272c9e2-42e5-4233-bec5-742436d7b47a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rr85x" Jul 16 22:18:41.763170 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.763133 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5272c9e2-42e5-4233-bec5-742436d7b47a-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-rr85x\" (UID: \"5272c9e2-42e5-4233-bec5-742436d7b47a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rr85x" Jul 16 22:18:41.763298 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.763213 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5272c9e2-42e5-4233-bec5-742436d7b47a-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-rr85x\" (UID: \"5272c9e2-42e5-4233-bec5-742436d7b47a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rr85x" Jul 16 22:18:41.864187 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.864147 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz6lk\" (UniqueName: \"kubernetes.io/projected/5272c9e2-42e5-4233-bec5-742436d7b47a-kube-api-access-cz6lk\") pod \"prometheus-operator-5945b5cfd-rr85x\" (UID: \"5272c9e2-42e5-4233-bec5-742436d7b47a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rr85x" Jul 16 22:18:41.864377 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.864207 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5272c9e2-42e5-4233-bec5-742436d7b47a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-rr85x\" (UID: \"5272c9e2-42e5-4233-bec5-742436d7b47a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rr85x" Jul 16 22:18:41.864377 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.864251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5272c9e2-42e5-4233-bec5-742436d7b47a-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-rr85x\" (UID: \"5272c9e2-42e5-4233-bec5-742436d7b47a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rr85x" Jul 16 22:18:41.864377 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.864294 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5272c9e2-42e5-4233-bec5-742436d7b47a-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-rr85x\" (UID: \"5272c9e2-42e5-4233-bec5-742436d7b47a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rr85x" Jul 16 22:18:41.864529 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:41.864427 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 16 22:18:41.864529 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:41.864488 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5272c9e2-42e5-4233-bec5-742436d7b47a-prometheus-operator-tls podName:5272c9e2-42e5-4233-bec5-742436d7b47a nodeName:}" failed. No retries permitted until 2026-07-16 22:18:42.36446888 +0000 UTC m=+288.467114094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/5272c9e2-42e5-4233-bec5-742436d7b47a-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-rr85x" (UID: "5272c9e2-42e5-4233-bec5-742436d7b47a") : secret "prometheus-operator-tls" not found Jul 16 22:18:41.865089 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.865038 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5272c9e2-42e5-4233-bec5-742436d7b47a-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-rr85x\" (UID: \"5272c9e2-42e5-4233-bec5-742436d7b47a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rr85x" Jul 16 22:18:41.867457 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.867407 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5272c9e2-42e5-4233-bec5-742436d7b47a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-rr85x\" (UID: \"5272c9e2-42e5-4233-bec5-742436d7b47a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rr85x" Jul 16 22:18:41.874747 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:41.874720 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz6lk\" (UniqueName: \"kubernetes.io/projected/5272c9e2-42e5-4233-bec5-742436d7b47a-kube-api-access-cz6lk\") pod \"prometheus-operator-5945b5cfd-rr85x\" (UID: \"5272c9e2-42e5-4233-bec5-742436d7b47a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rr85x" Jul 16 22:18:42.367898 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:42.367860 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5272c9e2-42e5-4233-bec5-742436d7b47a-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-rr85x\" (UID: \"5272c9e2-42e5-4233-bec5-742436d7b47a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rr85x" Jul 16 22:18:42.370491 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:42.370466 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5272c9e2-42e5-4233-bec5-742436d7b47a-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-rr85x\" (UID: \"5272c9e2-42e5-4233-bec5-742436d7b47a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rr85x" Jul 16 22:18:42.600011 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:42.599892 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-rr85x" Jul 16 22:18:42.745325 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:42.745278 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-rr85x"] Jul 16 22:18:42.752477 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:18:42.752451 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5272c9e2_42e5_4233_bec5_742436d7b47a.slice/crio-38fa202230e5cdd53addbd040469c9153377415b32d8ff22c271d50cae32335f WatchSource:0}: Error finding container 38fa202230e5cdd53addbd040469c9153377415b32d8ff22c271d50cae32335f: Status 404 returned error can't find the container with id 38fa202230e5cdd53addbd040469c9153377415b32d8ff22c271d50cae32335f Jul 16 22:18:43.380924 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:43.380882 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tsh7f" event={"ID":"d63ed4f5-feea-48bd-ab8b-c7249e46501b","Type":"ContainerStarted","Data":"bd9e4dca0fefa95cdca1157520df2362d5bb097d170a094e6dc4770cfd17f7b2"} Jul 16 22:18:43.381420 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:43.380950 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tsh7f" event={"ID":"d63ed4f5-feea-48bd-ab8b-c7249e46501b","Type":"ContainerStarted","Data":"9758b00296c38534fd20072f45a57ce475b6e11076f5c43e17b62e370094ea85"} Jul 16 22:18:43.381420 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:43.381158 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tsh7f" Jul 16 22:18:43.383128 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:43.383096 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-rr85x" event={"ID":"5272c9e2-42e5-4233-bec5-742436d7b47a","Type":"ContainerStarted","Data":"38fa202230e5cdd53addbd040469c9153377415b32d8ff22c271d50cae32335f"} Jul 16 22:18:43.400982 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:43.400926 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tsh7f" podStartSLOduration=251.488864324 podStartE2EDuration="4m13.400905985s" totalImagesPullingTime="1.912041661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:43.399032328 +0000 UTC m=+289.501677574" watchObservedRunningTime="2026-07-16 22:18:43.400905985 +0000 UTC m=+289.503551212" Jul 16 22:18:44.389215 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:44.389119 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-rr85x" event={"ID":"5272c9e2-42e5-4233-bec5-742436d7b47a","Type":"ContainerStarted","Data":"c1e36c0e0191f0192703a7b8050c5fe5b275b37d415f62782acad0d5cf228231"} Jul 16 22:18:44.389215 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:44.389190 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-rr85x" event={"ID":"5272c9e2-42e5-4233-bec5-742436d7b47a","Type":"ContainerStarted","Data":"085ed7e0b07cad3d6b37d63603dae47cc0251db9eb2205185f9da6b7d11bc6b4"} Jul 16 22:18:44.407439 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:44.407381 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-rr85x" podStartSLOduration=2.120687495 podStartE2EDuration="3.407359842s" totalImagesPullingTime="1.286672347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:44.4061559 +0000 UTC m=+290.508801152" watchObservedRunningTime="2026-07-16 22:18:44.407359842 +0000 UTC m=+290.510005070" Jul 16 22:18:46.012343 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.012307 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k"] Jul 16 22:18:46.015505 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.015482 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k" Jul 16 22:18:46.019297 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.019275 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 16 22:18:46.020459 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.020433 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2mv56\"" Jul 16 22:18:46.020459 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.020444 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 16 22:18:46.035202 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.035172 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k"] Jul 16 22:18:46.037325 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.036905 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dtwkf"] Jul 16 22:18:46.040757 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.040731 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.046885 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.046849 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 22:18:46.046885 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.046876 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 22:18:46.047109 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.046838 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 22:18:46.047109 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.047009 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5n7ln\"" Jul 16 22:18:46.103207 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.103164 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8299\" (UniqueName: \"kubernetes.io/projected/57e4b677-2f13-4793-9a14-4a0ce1d1b363-kube-api-access-g8299\") pod \"openshift-state-metrics-79f6958cdf-q2n7k\" (UID: \"57e4b677-2f13-4793-9a14-4a0ce1d1b363\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k" Jul 16 22:18:46.103395 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.103206 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/57e4b677-2f13-4793-9a14-4a0ce1d1b363-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-q2n7k\" (UID: \"57e4b677-2f13-4793-9a14-4a0ce1d1b363\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k" Jul 16 22:18:46.103395 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.103253 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrhf8\" (UniqueName: \"kubernetes.io/projected/00e3beb3-5c49-4d5c-b333-1403b22347bc-kube-api-access-xrhf8\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.103395 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.103273 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/00e3beb3-5c49-4d5c-b333-1403b22347bc-node-exporter-tls\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.103395 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.103291 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/00e3beb3-5c49-4d5c-b333-1403b22347bc-node-exporter-accelerators-collector-config\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.103395 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.103311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00e3beb3-5c49-4d5c-b333-1403b22347bc-metrics-client-ca\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.103628 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.103428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/00e3beb3-5c49-4d5c-b333-1403b22347bc-node-exporter-wtmp\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.103628 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.103510 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00e3beb3-5c49-4d5c-b333-1403b22347bc-sys\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.103628 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.103581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/00e3beb3-5c49-4d5c-b333-1403b22347bc-node-exporter-textfile\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.103753 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.103627 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/00e3beb3-5c49-4d5c-b333-1403b22347bc-root\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.103753 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.103656 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57e4b677-2f13-4793-9a14-4a0ce1d1b363-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-q2n7k\" (UID: \"57e4b677-2f13-4793-9a14-4a0ce1d1b363\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k" Jul 16 22:18:46.103753 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.103679 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00e3beb3-5c49-4d5c-b333-1403b22347bc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.103852 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.103775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57e4b677-2f13-4793-9a14-4a0ce1d1b363-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-q2n7k\" (UID: \"57e4b677-2f13-4793-9a14-4a0ce1d1b363\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k" Jul 16 22:18:46.204646 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.204607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00e3beb3-5c49-4d5c-b333-1403b22347bc-metrics-client-ca\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.204815 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.204663 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/00e3beb3-5c49-4d5c-b333-1403b22347bc-node-exporter-wtmp\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.204815 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.204703 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00e3beb3-5c49-4d5c-b333-1403b22347bc-sys\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.204815 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.204737 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/00e3beb3-5c49-4d5c-b333-1403b22347bc-node-exporter-textfile\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.204815 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.204774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/00e3beb3-5c49-4d5c-b333-1403b22347bc-root\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.204815 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.204800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57e4b677-2f13-4793-9a14-4a0ce1d1b363-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-q2n7k\" (UID: \"57e4b677-2f13-4793-9a14-4a0ce1d1b363\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k" Jul 16 22:18:46.205030 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.204824 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00e3beb3-5c49-4d5c-b333-1403b22347bc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.205030 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.204857 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57e4b677-2f13-4793-9a14-4a0ce1d1b363-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-q2n7k\" (UID: \"57e4b677-2f13-4793-9a14-4a0ce1d1b363\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k" Jul 16 22:18:46.205030 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.204894 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8299\" (UniqueName: \"kubernetes.io/projected/57e4b677-2f13-4793-9a14-4a0ce1d1b363-kube-api-access-g8299\") pod \"openshift-state-metrics-79f6958cdf-q2n7k\" (UID: \"57e4b677-2f13-4793-9a14-4a0ce1d1b363\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k" Jul 16 22:18:46.205030 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.204922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/57e4b677-2f13-4793-9a14-4a0ce1d1b363-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-q2n7k\" (UID: \"57e4b677-2f13-4793-9a14-4a0ce1d1b363\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k" Jul 16 22:18:46.205030 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.204945 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrhf8\" (UniqueName: \"kubernetes.io/projected/00e3beb3-5c49-4d5c-b333-1403b22347bc-kube-api-access-xrhf8\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.205030 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.204971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/00e3beb3-5c49-4d5c-b333-1403b22347bc-node-exporter-tls\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.205030 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.204995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/00e3beb3-5c49-4d5c-b333-1403b22347bc-node-exporter-accelerators-collector-config\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.205537 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.205317 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00e3beb3-5c49-4d5c-b333-1403b22347bc-metrics-client-ca\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.205537 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:46.205497 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 16 22:18:46.205537 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.205511 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/00e3beb3-5c49-4d5c-b333-1403b22347bc-node-exporter-wtmp\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.205778 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:46.205562 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00e3beb3-5c49-4d5c-b333-1403b22347bc-node-exporter-tls podName:00e3beb3-5c49-4d5c-b333-1403b22347bc nodeName:}" failed. No retries permitted until 2026-07-16 22:18:46.705543012 +0000 UTC m=+292.808188225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/00e3beb3-5c49-4d5c-b333-1403b22347bc-node-exporter-tls") pod "node-exporter-dtwkf" (UID: "00e3beb3-5c49-4d5c-b333-1403b22347bc") : secret "node-exporter-tls" not found Jul 16 22:18:46.205778 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.205500 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/00e3beb3-5c49-4d5c-b333-1403b22347bc-node-exporter-accelerators-collector-config\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.205778 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.205623 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/00e3beb3-5c49-4d5c-b333-1403b22347bc-node-exporter-textfile\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.205778 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.205697 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00e3beb3-5c49-4d5c-b333-1403b22347bc-sys\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.205778 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.205746 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/00e3beb3-5c49-4d5c-b333-1403b22347bc-root\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.206159 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.206132 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57e4b677-2f13-4793-9a14-4a0ce1d1b363-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-q2n7k\" (UID: \"57e4b677-2f13-4793-9a14-4a0ce1d1b363\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k" Jul 16 22:18:46.208108 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.208044 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00e3beb3-5c49-4d5c-b333-1403b22347bc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.208484 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.208447 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57e4b677-2f13-4793-9a14-4a0ce1d1b363-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-q2n7k\" (UID: \"57e4b677-2f13-4793-9a14-4a0ce1d1b363\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k" Jul 16 22:18:46.208571 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.208531 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/57e4b677-2f13-4793-9a14-4a0ce1d1b363-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-q2n7k\" (UID: \"57e4b677-2f13-4793-9a14-4a0ce1d1b363\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k" Jul 16 22:18:46.219381 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.219360 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8299\" (UniqueName: \"kubernetes.io/projected/57e4b677-2f13-4793-9a14-4a0ce1d1b363-kube-api-access-g8299\") pod \"openshift-state-metrics-79f6958cdf-q2n7k\" (UID: \"57e4b677-2f13-4793-9a14-4a0ce1d1b363\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k" Jul 16 22:18:46.224638 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.224605 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrhf8\" (UniqueName: \"kubernetes.io/projected/00e3beb3-5c49-4d5c-b333-1403b22347bc-kube-api-access-xrhf8\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.326712 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.326626 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k" Jul 16 22:18:46.478811 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.478775 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k"] Jul 16 22:18:46.482189 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:18:46.482158 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57e4b677_2f13_4793_9a14_4a0ce1d1b363.slice/crio-8704f3158f48ecd190a7a1de6942ad62f7a9a2612af2227503252be2527c3d68 WatchSource:0}: Error finding container 8704f3158f48ecd190a7a1de6942ad62f7a9a2612af2227503252be2527c3d68: Status 404 returned error can't find the container with id 8704f3158f48ecd190a7a1de6942ad62f7a9a2612af2227503252be2527c3d68 Jul 16 22:18:46.708407 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.708363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/00e3beb3-5c49-4d5c-b333-1403b22347bc-node-exporter-tls\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.711041 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.711011 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/00e3beb3-5c49-4d5c-b333-1403b22347bc-node-exporter-tls\") pod \"node-exporter-dtwkf\" (UID: \"00e3beb3-5c49-4d5c-b333-1403b22347bc\") " pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.954512 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:46.954472 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dtwkf" Jul 16 22:18:46.966432 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:18:46.966391 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00e3beb3_5c49_4d5c_b333_1403b22347bc.slice/crio-947d93c2e5677565aed92cc6cb32de4a0160b4aad9facedce9c453d087a49a17 WatchSource:0}: Error finding container 947d93c2e5677565aed92cc6cb32de4a0160b4aad9facedce9c453d087a49a17: Status 404 returned error can't find the container with id 947d93c2e5677565aed92cc6cb32de4a0160b4aad9facedce9c453d087a49a17 Jul 16 22:18:47.414996 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:47.414853 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dtwkf" event={"ID":"00e3beb3-5c49-4d5c-b333-1403b22347bc","Type":"ContainerStarted","Data":"947d93c2e5677565aed92cc6cb32de4a0160b4aad9facedce9c453d087a49a17"} Jul 16 22:18:47.418386 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:47.418190 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k" event={"ID":"57e4b677-2f13-4793-9a14-4a0ce1d1b363","Type":"ContainerStarted","Data":"f8ae392e307b649582923a1dd99845e03d017df938710e74166c263011693d0a"} Jul 16 22:18:47.418386 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:47.418274 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k" event={"ID":"57e4b677-2f13-4793-9a14-4a0ce1d1b363","Type":"ContainerStarted","Data":"e52f47394fe05e0bce5da8c364387b83e809edf8c2c71957964bb6de0e142172"} Jul 16 22:18:47.418386 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:47.418324 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k" event={"ID":"57e4b677-2f13-4793-9a14-4a0ce1d1b363","Type":"ContainerStarted","Data":"8704f3158f48ecd190a7a1de6942ad62f7a9a2612af2227503252be2527c3d68"} Jul 16 22:18:47.900327 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:47.900284 2578 patch_prober.go:28] interesting pod/image-registry-d47db56d-wvf5f container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 22:18:47.900508 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:47.900353 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-d47db56d-wvf5f" podUID="d4c9f17a-defc-42e8-8f0c-fb7f29a93375" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 22:18:48.077868 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.077829 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5cd99c4445-hds6x"] Jul 16 22:18:48.082639 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.082615 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.085983 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.085961 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 16 22:18:48.086117 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.086024 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 16 22:18:48.086607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.086383 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 16 22:18:48.086607 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.086442 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 16 22:18:48.087093 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.087018 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b6g60moskvpu2\"" Jul 16 22:18:48.087267 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.087240 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8fv5d\"" Jul 16 22:18:48.087474 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.087435 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 16 22:18:48.106285 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.106201 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5cd99c4445-hds6x"] Jul 16 22:18:48.120296 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.120267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d40b540-5b8a-47d0-9e71-d36813e33411-metrics-client-ca\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.120382 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.120305 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0d40b540-5b8a-47d0-9e71-d36813e33411-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.120382 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.120350 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d40b540-5b8a-47d0-9e71-d36813e33411-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.120470 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.120408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0d40b540-5b8a-47d0-9e71-d36813e33411-secret-thanos-querier-tls\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.120470 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.120451 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d40b540-5b8a-47d0-9e71-d36813e33411-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.120565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.120486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0d40b540-5b8a-47d0-9e71-d36813e33411-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.120565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.120503 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0d40b540-5b8a-47d0-9e71-d36813e33411-secret-grpc-tls\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.120565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.120526 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bjtm\" (UniqueName: \"kubernetes.io/projected/0d40b540-5b8a-47d0-9e71-d36813e33411-kube-api-access-8bjtm\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.221658 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.221620 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0d40b540-5b8a-47d0-9e71-d36813e33411-secret-thanos-querier-tls\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.221825 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.221679 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d40b540-5b8a-47d0-9e71-d36813e33411-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.221825 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.221703 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0d40b540-5b8a-47d0-9e71-d36813e33411-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.221825 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.221723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0d40b540-5b8a-47d0-9e71-d36813e33411-secret-grpc-tls\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.221825 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.221744 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bjtm\" (UniqueName: \"kubernetes.io/projected/0d40b540-5b8a-47d0-9e71-d36813e33411-kube-api-access-8bjtm\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.221825 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.221777 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d40b540-5b8a-47d0-9e71-d36813e33411-metrics-client-ca\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.221825 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.221802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0d40b540-5b8a-47d0-9e71-d36813e33411-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.222178 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.221849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d40b540-5b8a-47d0-9e71-d36813e33411-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.222843 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.222792 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d40b540-5b8a-47d0-9e71-d36813e33411-metrics-client-ca\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.224689 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.224664 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0d40b540-5b8a-47d0-9e71-d36813e33411-secret-thanos-querier-tls\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.224813 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.224703 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0d40b540-5b8a-47d0-9e71-d36813e33411-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.225281 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.225257 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0d40b540-5b8a-47d0-9e71-d36813e33411-secret-grpc-tls\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.225722 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.225701 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0d40b540-5b8a-47d0-9e71-d36813e33411-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.226059 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.226037 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d40b540-5b8a-47d0-9e71-d36813e33411-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.226722 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.226699 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d40b540-5b8a-47d0-9e71-d36813e33411-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.231431 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.231388 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bjtm\" (UniqueName: \"kubernetes.io/projected/0d40b540-5b8a-47d0-9e71-d36813e33411-kube-api-access-8bjtm\") pod \"thanos-querier-5cd99c4445-hds6x\" (UID: \"0d40b540-5b8a-47d0-9e71-d36813e33411\") " pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.395372 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.395253 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:18:48.429128 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.429095 2578 generic.go:356] "Generic (PLEG): container finished" podID="00e3beb3-5c49-4d5c-b333-1403b22347bc" containerID="9140f170afabaadf2f71f1bc18af2371cf698832f092fee297e245bec378f324" exitCode=0 Jul 16 22:18:48.432474 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.432447 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dtwkf" event={"ID":"00e3beb3-5c49-4d5c-b333-1403b22347bc","Type":"ContainerDied","Data":"9140f170afabaadf2f71f1bc18af2371cf698832f092fee297e245bec378f324"} Jul 16 22:18:48.432861 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.432835 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k" event={"ID":"57e4b677-2f13-4793-9a14-4a0ce1d1b363","Type":"ContainerStarted","Data":"d471b051cdd351350956096731fcf165acb0b74bf30f877e99a4796b994b40ed"} Jul 16 22:18:48.467300 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.467249 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-q2n7k" podStartSLOduration=2.459269775 podStartE2EDuration="3.467231235s" totalImagesPullingTime="1.00796146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:18:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:48.465710605 +0000 UTC m=+294.568355854" watchObservedRunningTime="2026-07-16 22:18:48.467231235 +0000 UTC m=+294.569876462" Jul 16 22:18:48.557728 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:48.557700 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5cd99c4445-hds6x"] Jul 16 22:18:48.567165 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:18:48.567137 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d40b540_5b8a_47d0_9e71_d36813e33411.slice/crio-607ea2d6d5f021dc6935d80c8fc2cfa615334f007c87357d341092ddfcd9789f WatchSource:0}: Error finding container 607ea2d6d5f021dc6935d80c8fc2cfa615334f007c87357d341092ddfcd9789f: Status 404 returned error can't find the container with id 607ea2d6d5f021dc6935d80c8fc2cfa615334f007c87357d341092ddfcd9789f Jul 16 22:18:49.438586 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:49.438551 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" event={"ID":"0d40b540-5b8a-47d0-9e71-d36813e33411","Type":"ContainerStarted","Data":"607ea2d6d5f021dc6935d80c8fc2cfa615334f007c87357d341092ddfcd9789f"} Jul 16 22:18:49.441242 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:49.441207 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dtwkf" event={"ID":"00e3beb3-5c49-4d5c-b333-1403b22347bc","Type":"ContainerStarted","Data":"69c2559fefeda11a96a215843bcb7c1a6d922edc66f74ecaa867cdae88430748"} Jul 16 22:18:49.441390 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:49.441265 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dtwkf" event={"ID":"00e3beb3-5c49-4d5c-b333-1403b22347bc","Type":"ContainerStarted","Data":"d42e0debec5b450d9c774c02a744246bcbbf3ea0dae99f70abfc8a8978b10a9a"} Jul 16 22:18:49.466528 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:49.466431 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dtwkf" podStartSLOduration=2.11038408 podStartE2EDuration="3.466388348s" totalImagesPullingTime="1.280161653s" totalInitContainerRuntime="75.842615ms" isStatefulPod=true podCreationTimestamp="2026-07-16 22:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:49.464969917 +0000 UTC m=+295.567615144" watchObservedRunningTime="2026-07-16 22:18:49.466388348 +0000 UTC m=+295.569033576" Jul 16 22:18:50.488726 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.488690 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-59f484df5-2kvc2"] Jul 16 22:18:50.492984 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.492959 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.496145 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.496118 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rgj4l\"" Jul 16 22:18:50.496395 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.496373 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 16 22:18:50.496510 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.496386 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 16 22:18:50.497676 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.497651 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 16 22:18:50.497788 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.497692 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8rjp8k73fgj8f\"" Jul 16 22:18:50.497846 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.497837 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 16 22:18:50.503764 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.503737 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-59f484df5-2kvc2"] Jul 16 22:18:50.545415 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.545380 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9b6905f1-d700-41c0-af29-1649dae716fd-secret-metrics-server-tls\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.545585 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.545496 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b6905f1-d700-41c0-af29-1649dae716fd-client-ca-bundle\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.545585 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.545553 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9b6905f1-d700-41c0-af29-1649dae716fd-audit-log\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.545701 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.545583 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9b6905f1-d700-41c0-af29-1649dae716fd-metrics-server-audit-profiles\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.545701 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.545677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t49nx\" (UniqueName: \"kubernetes.io/projected/9b6905f1-d700-41c0-af29-1649dae716fd-kube-api-access-t49nx\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.545797 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.545742 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b6905f1-d700-41c0-af29-1649dae716fd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.545797 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.545775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9b6905f1-d700-41c0-af29-1649dae716fd-secret-metrics-server-client-certs\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.646631 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.646598 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t49nx\" (UniqueName: \"kubernetes.io/projected/9b6905f1-d700-41c0-af29-1649dae716fd-kube-api-access-t49nx\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.646821 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.646652 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b6905f1-d700-41c0-af29-1649dae716fd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.646821 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.646798 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9b6905f1-d700-41c0-af29-1649dae716fd-secret-metrics-server-client-certs\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.646934 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.646859 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9b6905f1-d700-41c0-af29-1649dae716fd-secret-metrics-server-tls\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.646978 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.646930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b6905f1-d700-41c0-af29-1649dae716fd-client-ca-bundle\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.647144 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.647109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9b6905f1-d700-41c0-af29-1649dae716fd-audit-log\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.647257 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.647159 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9b6905f1-d700-41c0-af29-1649dae716fd-metrics-server-audit-profiles\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.647478 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.647427 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b6905f1-d700-41c0-af29-1649dae716fd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.647650 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.647623 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9b6905f1-d700-41c0-af29-1649dae716fd-audit-log\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.648241 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.648217 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9b6905f1-d700-41c0-af29-1649dae716fd-metrics-server-audit-profiles\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.649799 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.649777 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9b6905f1-d700-41c0-af29-1649dae716fd-secret-metrics-server-client-certs\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.649991 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.649965 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b6905f1-d700-41c0-af29-1649dae716fd-client-ca-bundle\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.650123 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.650021 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9b6905f1-d700-41c0-af29-1649dae716fd-secret-metrics-server-tls\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.656001 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.655976 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t49nx\" (UniqueName: \"kubernetes.io/projected/9b6905f1-d700-41c0-af29-1649dae716fd-kube-api-access-t49nx\") pod \"metrics-server-59f484df5-2kvc2\" (UID: \"9b6905f1-d700-41c0-af29-1649dae716fd\") " pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:50.806755 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:50.806668 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:18:51.340581 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.340539 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-56f946f45c-c4tgg"] Jul 16 22:18:51.344408 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.344375 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.347575 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.347463 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 16 22:18:51.347709 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.347577 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 16 22:18:51.347709 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.347592 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 16 22:18:51.347709 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.347626 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 16 22:18:51.347915 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.347892 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 16 22:18:51.348031 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.347955 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-sq5gn\"" Jul 16 22:18:51.353606 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.353557 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 16 22:18:51.356217 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.356194 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56f946f45c-c4tgg"] Jul 16 22:18:51.425888 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:18:51.425848 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lfgnf" podUID="e9988a04-8333-4c15-91b9-bf93b1d1bdd9" Jul 16 22:18:51.454617 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.454585 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f64bd23d-2487-40ad-9252-5dd9118eb764-secret-telemeter-client\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.454760 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.454647 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bfqw\" (UniqueName: \"kubernetes.io/projected/f64bd23d-2487-40ad-9252-5dd9118eb764-kube-api-access-8bfqw\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.454760 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.454691 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f64bd23d-2487-40ad-9252-5dd9118eb764-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.454760 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.454722 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64bd23d-2487-40ad-9252-5dd9118eb764-serving-certs-ca-bundle\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.454940 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.454765 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f64bd23d-2487-40ad-9252-5dd9118eb764-federate-client-tls\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.454940 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.454799 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f64bd23d-2487-40ad-9252-5dd9118eb764-metrics-client-ca\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.454940 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.454815 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64bd23d-2487-40ad-9252-5dd9118eb764-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.454940 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.454886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f64bd23d-2487-40ad-9252-5dd9118eb764-telemeter-client-tls\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.555563 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.555524 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f64bd23d-2487-40ad-9252-5dd9118eb764-metrics-client-ca\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.556022 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.555562 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64bd23d-2487-40ad-9252-5dd9118eb764-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.556022 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.555615 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f64bd23d-2487-40ad-9252-5dd9118eb764-telemeter-client-tls\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.556022 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.555649 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f64bd23d-2487-40ad-9252-5dd9118eb764-secret-telemeter-client\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.556022 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.555722 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bfqw\" (UniqueName: \"kubernetes.io/projected/f64bd23d-2487-40ad-9252-5dd9118eb764-kube-api-access-8bfqw\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.556022 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.555769 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f64bd23d-2487-40ad-9252-5dd9118eb764-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.556022 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.555818 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64bd23d-2487-40ad-9252-5dd9118eb764-serving-certs-ca-bundle\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.556022 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.556009 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f64bd23d-2487-40ad-9252-5dd9118eb764-federate-client-tls\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.556623 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.556531 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f64bd23d-2487-40ad-9252-5dd9118eb764-metrics-client-ca\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.557149 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.557095 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64bd23d-2487-40ad-9252-5dd9118eb764-serving-certs-ca-bundle\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.557371 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.557327 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64bd23d-2487-40ad-9252-5dd9118eb764-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.558992 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.558966 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f64bd23d-2487-40ad-9252-5dd9118eb764-secret-telemeter-client\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.559133 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.559090 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f64bd23d-2487-40ad-9252-5dd9118eb764-telemeter-client-tls\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.559221 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.559205 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f64bd23d-2487-40ad-9252-5dd9118eb764-federate-client-tls\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.559608 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.559581 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f64bd23d-2487-40ad-9252-5dd9118eb764-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.564306 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.564287 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bfqw\" (UniqueName: \"kubernetes.io/projected/f64bd23d-2487-40ad-9252-5dd9118eb764-kube-api-access-8bfqw\") pod \"telemeter-client-56f946f45c-c4tgg\" (UID: \"f64bd23d-2487-40ad-9252-5dd9118eb764\") " pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:51.657635 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:51.657545 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" Jul 16 22:18:53.391776 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:53.391745 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tsh7f" Jul 16 22:18:53.948591 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:53.948551 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8465545f64-f8zzp"] Jul 16 22:18:53.952162 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:53.952142 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:53.954948 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:53.954930 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 22:18:53.956333 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:53.956225 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 22:18:53.956333 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:53.956240 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 22:18:53.956333 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:53.956285 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ct4lz\"" Jul 16 22:18:53.956333 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:53.956285 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 22:18:53.956919 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:53.956861 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 22:18:53.961311 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:53.961290 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 16 22:18:53.962526 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:53.962504 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8465545f64-f8zzp"] Jul 16 22:18:54.082516 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.082480 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8385032-ff44-4374-8e14-3b14c2bcb8b6-console-serving-cert\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.082700 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.082536 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8385032-ff44-4374-8e14-3b14c2bcb8b6-console-oauth-config\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.082700 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.082565 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-service-ca\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.082700 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.082629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-trusted-ca-bundle\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.082700 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.082668 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-oauth-serving-cert\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.082869 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.082708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-console-config\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.082869 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.082779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgpxd\" (UniqueName: \"kubernetes.io/projected/a8385032-ff44-4374-8e14-3b14c2bcb8b6-kube-api-access-vgpxd\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.183938 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.183894 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8385032-ff44-4374-8e14-3b14c2bcb8b6-console-oauth-config\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.183938 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.183940 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-service-ca\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.184230 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.183958 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-trusted-ca-bundle\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.184230 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.184093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-oauth-serving-cert\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.184336 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.184235 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-console-config\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.184336 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.184304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgpxd\" (UniqueName: \"kubernetes.io/projected/a8385032-ff44-4374-8e14-3b14c2bcb8b6-kube-api-access-vgpxd\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.184802 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.184441 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8385032-ff44-4374-8e14-3b14c2bcb8b6-console-serving-cert\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.184802 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.184776 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-service-ca\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.185000 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.184968 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-console-config\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.185207 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.185186 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-trusted-ca-bundle\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.185325 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.185311 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-oauth-serving-cert\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.186845 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.186823 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8385032-ff44-4374-8e14-3b14c2bcb8b6-console-oauth-config\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.187019 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.186998 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8385032-ff44-4374-8e14-3b14c2bcb8b6-console-serving-cert\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.194631 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.194606 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgpxd\" (UniqueName: \"kubernetes.io/projected/a8385032-ff44-4374-8e14-3b14c2bcb8b6-kube-api-access-vgpxd\") pod \"console-8465545f64-f8zzp\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:54.266441 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.266368 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ct4lz\"" Jul 16 22:18:54.273714 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:54.273689 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:18:57.898315 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:57.898285 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:18:58.606059 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:58.605976 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:18:58.609702 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:58.609640 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:18:58.631258 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:58.630228 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 22:18:58.741279 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:58.740919 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-59f484df5-2kvc2"] Jul 16 22:18:58.749268 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:18:58.749238 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6905f1_d700_41c0_af29_1649dae716fd.slice/crio-a2c7b74e5d4beec84804d9c142b89031c5280a9a2eb4516cb2a2764716ccbdb0 WatchSource:0}: Error finding container a2c7b74e5d4beec84804d9c142b89031c5280a9a2eb4516cb2a2764716ccbdb0: Status 404 returned error can't find the container with id a2c7b74e5d4beec84804d9c142b89031c5280a9a2eb4516cb2a2764716ccbdb0 Jul 16 22:18:58.751361 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:58.751340 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 22:18:58.774225 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:58.774200 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56f946f45c-c4tgg"] Jul 16 22:18:58.774910 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:18:58.774889 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf64bd23d_2487_40ad_9252_5dd9118eb764.slice/crio-6a6e836e012581d37f15fadc28cf1c79d013b17d74157149b11da75188ef19ac WatchSource:0}: Error finding container 6a6e836e012581d37f15fadc28cf1c79d013b17d74157149b11da75188ef19ac: Status 404 returned error can't find the container with id 6a6e836e012581d37f15fadc28cf1c79d013b17d74157149b11da75188ef19ac Jul 16 22:18:58.971103 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:58.971049 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8465545f64-f8zzp"] Jul 16 22:18:58.974133 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:18:58.974100 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8385032_ff44_4374_8e14_3b14c2bcb8b6.slice/crio-0a14714448fad1263f61f22775f273c4a8317b2a56c2ddabe1308d35e08f5b0d WatchSource:0}: Error finding container 0a14714448fad1263f61f22775f273c4a8317b2a56c2ddabe1308d35e08f5b0d: Status 404 returned error can't find the container with id 0a14714448fad1263f61f22775f273c4a8317b2a56c2ddabe1308d35e08f5b0d Jul 16 22:18:59.487860 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:59.487694 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8465545f64-f8zzp" event={"ID":"a8385032-ff44-4374-8e14-3b14c2bcb8b6","Type":"ContainerStarted","Data":"0a14714448fad1263f61f22775f273c4a8317b2a56c2ddabe1308d35e08f5b0d"} Jul 16 22:18:59.490839 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:59.490741 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" event={"ID":"9b6905f1-d700-41c0-af29-1649dae716fd","Type":"ContainerStarted","Data":"a2c7b74e5d4beec84804d9c142b89031c5280a9a2eb4516cb2a2764716ccbdb0"} Jul 16 22:18:59.495301 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:59.495060 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" event={"ID":"0d40b540-5b8a-47d0-9e71-d36813e33411","Type":"ContainerStarted","Data":"0c9b498a33f66287110c1e2db40d8e08b1d28d40c6b783e510c1293c00b39756"} Jul 16 22:18:59.495301 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:59.495158 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" event={"ID":"0d40b540-5b8a-47d0-9e71-d36813e33411","Type":"ContainerStarted","Data":"0770c01ea35ce228b1d662067cf8c359305a909670eac688c2c4fe08c493d489"} Jul 16 22:18:59.495301 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:59.495207 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" event={"ID":"0d40b540-5b8a-47d0-9e71-d36813e33411","Type":"ContainerStarted","Data":"81a4e0ed8ed6c1fcd0976b8f30ca9fd5bb6d5e093b5f31200604f4df934c59e4"} Jul 16 22:18:59.498706 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:59.498410 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-bm4xf" event={"ID":"64615f5e-5127-4c4a-9e3a-1f4562baabf5","Type":"ContainerStarted","Data":"4c2503bd532d416847aa595d2893ba703716b2d9fcf544ba5d18ea041becb25e"} Jul 16 22:18:59.498706 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:59.498639 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-bm4xf" Jul 16 22:18:59.501608 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:59.501583 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" event={"ID":"f64bd23d-2487-40ad-9252-5dd9118eb764","Type":"ContainerStarted","Data":"6a6e836e012581d37f15fadc28cf1c79d013b17d74157149b11da75188ef19ac"} Jul 16 22:18:59.512393 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:59.512365 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-bm4xf" Jul 16 22:18:59.520930 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:18:59.519692 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-bm4xf" podStartSLOduration=3.892554524 podStartE2EDuration="22.519670838s" totalImagesPullingTime="18.627116314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:59.517915499 +0000 UTC m=+305.620560728" watchObservedRunningTime="2026-07-16 22:18:59.519670838 +0000 UTC m=+305.622316065" Jul 16 22:19:00.516367 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:00.516120 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" event={"ID":"0d40b540-5b8a-47d0-9e71-d36813e33411","Type":"ContainerStarted","Data":"0f2164077089fdcf9abcdbdb525a40eff20696b9322383c7266b728a71ccc097"} Jul 16 22:19:00.516367 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:00.516196 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" event={"ID":"0d40b540-5b8a-47d0-9e71-d36813e33411","Type":"ContainerStarted","Data":"06f8fda0632031982f1cd43af55060e7a780c11f657801d829ef890f177975e0"} Jul 16 22:19:00.516367 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:00.516240 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" event={"ID":"0d40b540-5b8a-47d0-9e71-d36813e33411","Type":"ContainerStarted","Data":"97ab794dfca9c033b4e389faa076c5649b6cb82b7294b4687ae049576013cf1c"} Jul 16 22:19:00.516367 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:00.516314 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:19:00.546188 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:00.545479 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" podStartSLOduration=1.710229972 podStartE2EDuration="12.545454535s" totalImagesPullingTime="10.835224563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:18:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:19:00.542976523 +0000 UTC m=+306.645621766" watchObservedRunningTime="2026-07-16 22:19:00.545454535 +0000 UTC m=+306.648099764" Jul 16 22:19:01.376219 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:01.375523 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d449d7d49-lqpdh" Jul 16 22:19:02.917501 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:02.917411 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-d47db56d-wvf5f" podUID="d4c9f17a-defc-42e8-8f0c-fb7f29a93375" containerName="registry" containerID="cri-o://dc399898a2a0111068552fad0a35732e4680dad6aa9a75ddd6c838c086916191" gracePeriod=30 Jul 16 22:19:03.794884 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:03.794853 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:19:03.899057 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:03.899032 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls\") pod \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " Jul 16 22:19:03.899174 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:03.899097 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-image-registry-private-configuration\") pod \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " Jul 16 22:19:03.899174 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:03.899127 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-bound-sa-token\") pod \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " Jul 16 22:19:03.900339 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:03.899229 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cttxb\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-kube-api-access-cttxb\") pod \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " Jul 16 22:19:03.900339 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:03.899283 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-installation-pull-secrets\") pod \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " Jul 16 22:19:03.900339 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:03.899344 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-ca-trust-extracted\") pod \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " Jul 16 22:19:03.900339 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:03.899386 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-certificates\") pod \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " Jul 16 22:19:03.900339 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:03.899437 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-trusted-ca\") pod \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\" (UID: \"d4c9f17a-defc-42e8-8f0c-fb7f29a93375\") " Jul 16 22:19:03.900339 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:03.899953 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d4c9f17a-defc-42e8-8f0c-fb7f29a93375" (UID: "d4c9f17a-defc-42e8-8f0c-fb7f29a93375"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:19:03.900339 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:03.900120 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d4c9f17a-defc-42e8-8f0c-fb7f29a93375" (UID: "d4c9f17a-defc-42e8-8f0c-fb7f29a93375"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:19:03.902757 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:03.902698 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-kube-api-access-cttxb" (OuterVolumeSpecName: "kube-api-access-cttxb") pod "d4c9f17a-defc-42e8-8f0c-fb7f29a93375" (UID: "d4c9f17a-defc-42e8-8f0c-fb7f29a93375"). InnerVolumeSpecName "kube-api-access-cttxb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:19:03.903823 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:03.903774 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d4c9f17a-defc-42e8-8f0c-fb7f29a93375" (UID: "d4c9f17a-defc-42e8-8f0c-fb7f29a93375"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 22:19:03.903823 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:03.903776 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d4c9f17a-defc-42e8-8f0c-fb7f29a93375" (UID: "d4c9f17a-defc-42e8-8f0c-fb7f29a93375"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:19:03.903823 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:03.903801 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d4c9f17a-defc-42e8-8f0c-fb7f29a93375" (UID: "d4c9f17a-defc-42e8-8f0c-fb7f29a93375"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:19:03.905641 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:03.905593 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d4c9f17a-defc-42e8-8f0c-fb7f29a93375" (UID: "d4c9f17a-defc-42e8-8f0c-fb7f29a93375"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 22:19:03.912926 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:03.912887 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d4c9f17a-defc-42e8-8f0c-fb7f29a93375" (UID: "d4c9f17a-defc-42e8-8f0c-fb7f29a93375"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:19:04.000457 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.000414 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-tls\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:19:04.000457 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.000457 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-image-registry-private-configuration\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:19:04.000937 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.000471 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-bound-sa-token\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:19:04.000937 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.000484 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cttxb\" (UniqueName: \"kubernetes.io/projected/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-kube-api-access-cttxb\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:19:04.000937 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.000497 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-installation-pull-secrets\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:19:04.000937 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.000510 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-ca-trust-extracted\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:19:04.000937 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.000523 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-registry-certificates\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:19:04.000937 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.000535 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4c9f17a-defc-42e8-8f0c-fb7f29a93375-trusted-ca\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:19:04.547649 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.547607 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" event={"ID":"f64bd23d-2487-40ad-9252-5dd9118eb764","Type":"ContainerStarted","Data":"e284d2f196f741b2ebb0e9e1cf4c6a754dbe136679c4385d1483bb0c9b7c18f6"} Jul 16 22:19:04.549271 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.549236 2578 generic.go:356] "Generic (PLEG): container finished" podID="d4c9f17a-defc-42e8-8f0c-fb7f29a93375" containerID="dc399898a2a0111068552fad0a35732e4680dad6aa9a75ddd6c838c086916191" exitCode=0 Jul 16 22:19:04.549419 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.549283 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d47db56d-wvf5f" Jul 16 22:19:04.549419 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.549326 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d47db56d-wvf5f" event={"ID":"d4c9f17a-defc-42e8-8f0c-fb7f29a93375","Type":"ContainerDied","Data":"dc399898a2a0111068552fad0a35732e4680dad6aa9a75ddd6c838c086916191"} Jul 16 22:19:04.549419 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.549364 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d47db56d-wvf5f" event={"ID":"d4c9f17a-defc-42e8-8f0c-fb7f29a93375","Type":"ContainerDied","Data":"14f409cf89c0c27834a3931b2a9b3383ae1cd6320a410b93a65f871100ee1b70"} Jul 16 22:19:04.549419 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.549389 2578 scope.go:117] "RemoveContainer" containerID="dc399898a2a0111068552fad0a35732e4680dad6aa9a75ddd6c838c086916191" Jul 16 22:19:04.552018 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.551961 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8465545f64-f8zzp" event={"ID":"a8385032-ff44-4374-8e14-3b14c2bcb8b6","Type":"ContainerStarted","Data":"4ebdd8affebdad0187bd47cc4f1c5977aae750c68a0385b490dcb71df3ea625b"} Jul 16 22:19:04.553974 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.553938 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" event={"ID":"9b6905f1-d700-41c0-af29-1649dae716fd","Type":"ContainerStarted","Data":"e36086c7c842ce41ac707db85a3e23e9eacba63eb91dfd83c01cbeee890c182a"} Jul 16 22:19:04.560086 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.560044 2578 scope.go:117] "RemoveContainer" containerID="dc399898a2a0111068552fad0a35732e4680dad6aa9a75ddd6c838c086916191" Jul 16 22:19:04.560444 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:19:04.560412 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc399898a2a0111068552fad0a35732e4680dad6aa9a75ddd6c838c086916191\": container with ID starting with dc399898a2a0111068552fad0a35732e4680dad6aa9a75ddd6c838c086916191 not found: ID does not exist" containerID="dc399898a2a0111068552fad0a35732e4680dad6aa9a75ddd6c838c086916191" Jul 16 22:19:04.560534 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.560452 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc399898a2a0111068552fad0a35732e4680dad6aa9a75ddd6c838c086916191"} err="failed to get container status \"dc399898a2a0111068552fad0a35732e4680dad6aa9a75ddd6c838c086916191\": rpc error: code = NotFound desc = could not find container \"dc399898a2a0111068552fad0a35732e4680dad6aa9a75ddd6c838c086916191\": container with ID starting with dc399898a2a0111068552fad0a35732e4680dad6aa9a75ddd6c838c086916191 not found: ID does not exist" Jul 16 22:19:04.569226 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.569203 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d47db56d-wvf5f"] Jul 16 22:19:04.572424 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.572402 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-d47db56d-wvf5f"] Jul 16 22:19:04.588495 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.588442 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" podStartSLOduration=9.516087674 podStartE2EDuration="14.588421148s" totalImagesPullingTime="5.072333474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:19:04.588344831 +0000 UTC m=+310.690990057" watchObservedRunningTime="2026-07-16 22:19:04.588421148 +0000 UTC m=+310.691066375" Jul 16 22:19:04.607417 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:04.607363 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8465545f64-f8zzp" podStartSLOduration=6.753293541 podStartE2EDuration="11.607344118s" totalImagesPullingTime="4.854050577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:19:04.606988938 +0000 UTC m=+310.709634184" watchObservedRunningTime="2026-07-16 22:19:04.607344118 +0000 UTC m=+310.709989365" Jul 16 22:19:05.425135 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:05.424480 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:19:06.431582 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:06.431551 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4c9f17a-defc-42e8-8f0c-fb7f29a93375" path="/var/lib/kubelet/pods/d4c9f17a-defc-42e8-8f0c-fb7f29a93375/volumes" Jul 16 22:19:06.530342 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:06.530311 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5cd99c4445-hds6x" Jul 16 22:19:06.566913 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:06.566845 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" event={"ID":"f64bd23d-2487-40ad-9252-5dd9118eb764","Type":"ContainerStarted","Data":"7cd1a48c040394a10a8b0bd8c4b540afcd8747b14256bb58559ed4e59962c695"} Jul 16 22:19:06.567055 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:06.566912 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" event={"ID":"f64bd23d-2487-40ad-9252-5dd9118eb764","Type":"ContainerStarted","Data":"d0a188ecd676df76a10195ac2ae288c83b5196d9cbce51bf1237ac18fc07abb7"} Jul 16 22:19:07.600764 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:07.600705 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-56f946f45c-c4tgg" podStartSLOduration=9.217452863 podStartE2EDuration="16.600685913s" totalImagesPullingTime="7.38323305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:18:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:19:07.599855179 +0000 UTC m=+313.702500469" watchObservedRunningTime="2026-07-16 22:19:07.600685913 +0000 UTC m=+313.703331140" Jul 16 22:19:08.364649 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:08.364606 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8465545f64-f8zzp"] Jul 16 22:19:10.807098 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:10.807051 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:19:10.807496 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:10.807124 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:19:14.274548 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:14.274507 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:19:30.812188 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:30.812161 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:19:30.815987 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:30.815965 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-59f484df5-2kvc2" Jul 16 22:19:33.387228 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.387185 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8465545f64-f8zzp" podUID="a8385032-ff44-4374-8e14-3b14c2bcb8b6" containerName="console" containerID="cri-o://4ebdd8affebdad0187bd47cc4f1c5977aae750c68a0385b490dcb71df3ea625b" gracePeriod=15 Jul 16 22:19:33.671459 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.671386 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:19:33.671790 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.671767 2578 generic.go:356] "Generic (PLEG): container finished" podID="a8385032-ff44-4374-8e14-3b14c2bcb8b6" containerID="4ebdd8affebdad0187bd47cc4f1c5977aae750c68a0385b490dcb71df3ea625b" exitCode=0 Jul 16 22:19:33.671873 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.671847 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8465545f64-f8zzp" event={"ID":"a8385032-ff44-4374-8e14-3b14c2bcb8b6","Type":"ContainerDied","Data":"4ebdd8affebdad0187bd47cc4f1c5977aae750c68a0385b490dcb71df3ea625b"} Jul 16 22:19:33.671931 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.671915 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8465545f64-f8zzp" event={"ID":"a8385032-ff44-4374-8e14-3b14c2bcb8b6","Type":"ContainerDied","Data":"0a14714448fad1263f61f22775f273c4a8317b2a56c2ddabe1308d35e08f5b0d"} Jul 16 22:19:33.671989 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.671948 2578 scope.go:117] "RemoveContainer" containerID="4ebdd8affebdad0187bd47cc4f1c5977aae750c68a0385b490dcb71df3ea625b" Jul 16 22:19:33.680488 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.680467 2578 scope.go:117] "RemoveContainer" containerID="4ebdd8affebdad0187bd47cc4f1c5977aae750c68a0385b490dcb71df3ea625b" Jul 16 22:19:33.680799 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:19:33.680774 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ebdd8affebdad0187bd47cc4f1c5977aae750c68a0385b490dcb71df3ea625b\": container with ID starting with 4ebdd8affebdad0187bd47cc4f1c5977aae750c68a0385b490dcb71df3ea625b not found: ID does not exist" containerID="4ebdd8affebdad0187bd47cc4f1c5977aae750c68a0385b490dcb71df3ea625b" Jul 16 22:19:33.680901 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.680805 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ebdd8affebdad0187bd47cc4f1c5977aae750c68a0385b490dcb71df3ea625b"} err="failed to get container status \"4ebdd8affebdad0187bd47cc4f1c5977aae750c68a0385b490dcb71df3ea625b\": rpc error: code = NotFound desc = could not find container \"4ebdd8affebdad0187bd47cc4f1c5977aae750c68a0385b490dcb71df3ea625b\": container with ID starting with 4ebdd8affebdad0187bd47cc4f1c5977aae750c68a0385b490dcb71df3ea625b not found: ID does not exist" Jul 16 22:19:33.757424 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.757396 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-trusted-ca-bundle\") pod \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " Jul 16 22:19:33.757571 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.757450 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-service-ca\") pod \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " Jul 16 22:19:33.757571 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.757471 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-oauth-serving-cert\") pod \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " Jul 16 22:19:33.757679 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.757585 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-console-config\") pod \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " Jul 16 22:19:33.757679 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.757617 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8385032-ff44-4374-8e14-3b14c2bcb8b6-console-oauth-config\") pod \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " Jul 16 22:19:33.757679 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.757641 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8385032-ff44-4374-8e14-3b14c2bcb8b6-console-serving-cert\") pod \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " Jul 16 22:19:33.757679 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.757675 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgpxd\" (UniqueName: \"kubernetes.io/projected/a8385032-ff44-4374-8e14-3b14c2bcb8b6-kube-api-access-vgpxd\") pod \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\" (UID: \"a8385032-ff44-4374-8e14-3b14c2bcb8b6\") " Jul 16 22:19:33.757889 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.757870 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a8385032-ff44-4374-8e14-3b14c2bcb8b6" (UID: "a8385032-ff44-4374-8e14-3b14c2bcb8b6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:19:33.757945 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.757887 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a8385032-ff44-4374-8e14-3b14c2bcb8b6" (UID: "a8385032-ff44-4374-8e14-3b14c2bcb8b6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:19:33.757945 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.757900 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-service-ca" (OuterVolumeSpecName: "service-ca") pod "a8385032-ff44-4374-8e14-3b14c2bcb8b6" (UID: "a8385032-ff44-4374-8e14-3b14c2bcb8b6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:19:33.758117 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.757986 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-console-config" (OuterVolumeSpecName: "console-config") pod "a8385032-ff44-4374-8e14-3b14c2bcb8b6" (UID: "a8385032-ff44-4374-8e14-3b14c2bcb8b6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:19:33.758117 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.758015 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-trusted-ca-bundle\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:19:33.758117 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.758030 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-service-ca\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:19:33.758117 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.758039 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-oauth-serving-cert\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:19:33.759782 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.759752 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8385032-ff44-4374-8e14-3b14c2bcb8b6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a8385032-ff44-4374-8e14-3b14c2bcb8b6" (UID: "a8385032-ff44-4374-8e14-3b14c2bcb8b6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 22:19:33.759878 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.759841 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8385032-ff44-4374-8e14-3b14c2bcb8b6-kube-api-access-vgpxd" (OuterVolumeSpecName: "kube-api-access-vgpxd") pod "a8385032-ff44-4374-8e14-3b14c2bcb8b6" (UID: "a8385032-ff44-4374-8e14-3b14c2bcb8b6"). InnerVolumeSpecName "kube-api-access-vgpxd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:19:33.759930 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.759911 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8385032-ff44-4374-8e14-3b14c2bcb8b6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a8385032-ff44-4374-8e14-3b14c2bcb8b6" (UID: "a8385032-ff44-4374-8e14-3b14c2bcb8b6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 22:19:33.858576 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.858539 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8385032-ff44-4374-8e14-3b14c2bcb8b6-console-config\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:19:33.858576 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.858570 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8385032-ff44-4374-8e14-3b14c2bcb8b6-console-oauth-config\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:19:33.858576 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.858579 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8385032-ff44-4374-8e14-3b14c2bcb8b6-console-serving-cert\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:19:33.858576 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:33.858589 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgpxd\" (UniqueName: \"kubernetes.io/projected/a8385032-ff44-4374-8e14-3b14c2bcb8b6-kube-api-access-vgpxd\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:19:34.676620 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:34.676589 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8465545f64-f8zzp" Jul 16 22:19:34.695013 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:34.694984 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8465545f64-f8zzp"] Jul 16 22:19:34.698777 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:34.698754 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8465545f64-f8zzp"] Jul 16 22:19:36.430541 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:36.430461 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8385032-ff44-4374-8e14-3b14c2bcb8b6" path="/var/lib/kubelet/pods/a8385032-ff44-4374-8e14-3b14c2bcb8b6/volumes" Jul 16 22:19:36.685499 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:36.685416 2578 generic.go:356] "Generic (PLEG): container finished" podID="1842e1a9-c878-48f6-a65c-97d722626fbd" containerID="060e433e6939c8acae0b312d4f2517304161d7430754dc86e774de392fc38420" exitCode=0 Jul 16 22:19:36.685634 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:36.685500 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-x9kn9" event={"ID":"1842e1a9-c878-48f6-a65c-97d722626fbd","Type":"ContainerDied","Data":"060e433e6939c8acae0b312d4f2517304161d7430754dc86e774de392fc38420"} Jul 16 22:19:36.685836 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:36.685822 2578 scope.go:117] "RemoveContainer" containerID="060e433e6939c8acae0b312d4f2517304161d7430754dc86e774de392fc38420" Jul 16 22:19:37.691040 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:19:37.691009 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-x9kn9" event={"ID":"1842e1a9-c878-48f6-a65c-97d722626fbd","Type":"ContainerStarted","Data":"29c98de7646e088d40dc3ed7695afd088b41ca12f5819b27f43c7e901f437def"} Jul 16 22:20:08.221601 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.221565 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 22:20:08.222029 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.221891 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c9f17a-defc-42e8-8f0c-fb7f29a93375" containerName="registry" Jul 16 22:20:08.222029 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.221903 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c9f17a-defc-42e8-8f0c-fb7f29a93375" containerName="registry" Jul 16 22:20:08.222029 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.221917 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8385032-ff44-4374-8e14-3b14c2bcb8b6" containerName="console" Jul 16 22:20:08.222029 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.221923 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8385032-ff44-4374-8e14-3b14c2bcb8b6" containerName="console" Jul 16 22:20:08.222029 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.221978 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8385032-ff44-4374-8e14-3b14c2bcb8b6" containerName="console" Jul 16 22:20:08.222029 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.221988 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4c9f17a-defc-42e8-8f0c-fb7f29a93375" containerName="registry" Jul 16 22:20:08.225837 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.225816 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.228567 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.228546 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 16 22:20:08.228693 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.228569 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 16 22:20:08.228843 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.228827 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qzmfs\"" Jul 16 22:20:08.228959 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.228937 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 16 22:20:08.228959 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.228952 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 16 22:20:08.229122 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.228952 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 16 22:20:08.229122 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.228970 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 16 22:20:08.229122 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.229104 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 16 22:20:08.230321 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.230293 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 16 22:20:08.234193 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.234175 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 16 22:20:08.243954 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.243929 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 22:20:08.253117 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.253085 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/daaebddc-3869-4807-b254-b329abe2a07f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.253219 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.253120 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.253219 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.253155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daaebddc-3869-4807-b254-b329abe2a07f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.253219 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.253179 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.253326 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.253233 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daaebddc-3869-4807-b254-b329abe2a07f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.253326 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.253254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv6hn\" (UniqueName: \"kubernetes.io/projected/daaebddc-3869-4807-b254-b329abe2a07f-kube-api-access-rv6hn\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.253326 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.253280 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.253428 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.253331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.253428 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.253377 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.253488 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.253431 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/daaebddc-3869-4807-b254-b329abe2a07f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.253488 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.253478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/daaebddc-3869-4807-b254-b329abe2a07f-config-out\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.253558 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.253501 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-web-config\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.253558 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.253535 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-config-volume\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.354569 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.354527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daaebddc-3869-4807-b254-b329abe2a07f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.354569 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.354572 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.354816 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.354603 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daaebddc-3869-4807-b254-b329abe2a07f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.354816 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.354630 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv6hn\" (UniqueName: \"kubernetes.io/projected/daaebddc-3869-4807-b254-b329abe2a07f-kube-api-access-rv6hn\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.354816 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.354647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.354816 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.354665 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.354816 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.354684 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.355059 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.354732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/daaebddc-3869-4807-b254-b329abe2a07f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.355059 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.354861 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs\") pod \"network-metrics-daemon-lfgnf\" (UID: \"e9988a04-8333-4c15-91b9-bf93b1d1bdd9\") " pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:20:08.355059 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.354884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/daaebddc-3869-4807-b254-b329abe2a07f-config-out\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.355059 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.354905 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-web-config\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.355059 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.354940 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-config-volume\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.355059 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.354968 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/daaebddc-3869-4807-b254-b329abe2a07f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.355059 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.354991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.355604 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.355579 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daaebddc-3869-4807-b254-b329abe2a07f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.356366 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.355945 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daaebddc-3869-4807-b254-b329abe2a07f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.356503 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.356009 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/daaebddc-3869-4807-b254-b329abe2a07f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.357946 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.357917 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/daaebddc-3869-4807-b254-b329abe2a07f-config-out\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.358044 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.358024 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.358672 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.358337 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.358672 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.358501 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.358818 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.358673 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.359037 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.359013 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9988a04-8333-4c15-91b9-bf93b1d1bdd9-metrics-certs\") pod \"network-metrics-daemon-lfgnf\" (UID: \"e9988a04-8333-4c15-91b9-bf93b1d1bdd9\") " pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:20:08.359150 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.359124 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.359202 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.359129 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-config-volume\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.359477 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.359460 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/daaebddc-3869-4807-b254-b329abe2a07f-web-config\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.360014 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.359996 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/daaebddc-3869-4807-b254-b329abe2a07f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.364274 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.364254 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv6hn\" (UniqueName: \"kubernetes.io/projected/daaebddc-3869-4807-b254-b329abe2a07f-kube-api-access-rv6hn\") pod \"alertmanager-main-0\" (UID: \"daaebddc-3869-4807-b254-b329abe2a07f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.429174 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.429143 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7sbmm\"" Jul 16 22:20:08.436520 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.436496 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfgnf" Jul 16 22:20:08.535612 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.535585 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 22:20:08.564709 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.564686 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lfgnf"] Jul 16 22:20:08.567169 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:20:08.567139 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9988a04_8333_4c15_91b9_bf93b1d1bdd9.slice/crio-7194de6e1d4d4fd6d92b64eb6b5f949a27b689effef3c02563b1ec99d28358f0 WatchSource:0}: Error finding container 7194de6e1d4d4fd6d92b64eb6b5f949a27b689effef3c02563b1ec99d28358f0: Status 404 returned error can't find the container with id 7194de6e1d4d4fd6d92b64eb6b5f949a27b689effef3c02563b1ec99d28358f0 Jul 16 22:20:08.671553 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.671515 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 22:20:08.675429 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:20:08.675390 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaaebddc_3869_4807_b254_b329abe2a07f.slice/crio-25e8121bea66e59ff635d3578da579398b54b797f5a9ae868a062771901b928c WatchSource:0}: Error finding container 25e8121bea66e59ff635d3578da579398b54b797f5a9ae868a062771901b928c: Status 404 returned error can't find the container with id 25e8121bea66e59ff635d3578da579398b54b797f5a9ae868a062771901b928c Jul 16 22:20:08.818121 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.818092 2578 generic.go:356] "Generic (PLEG): container finished" podID="daaebddc-3869-4807-b254-b329abe2a07f" containerID="cf7b5268d265571f07f3d25bf33de453a6efaaa9561b07d3a00a5da85f608bd9" exitCode=0 Jul 16 22:20:08.818292 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.818165 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daaebddc-3869-4807-b254-b329abe2a07f","Type":"ContainerDied","Data":"cf7b5268d265571f07f3d25bf33de453a6efaaa9561b07d3a00a5da85f608bd9"} Jul 16 22:20:08.818292 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.818226 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daaebddc-3869-4807-b254-b329abe2a07f","Type":"ContainerStarted","Data":"25e8121bea66e59ff635d3578da579398b54b797f5a9ae868a062771901b928c"} Jul 16 22:20:08.819395 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:08.819370 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lfgnf" event={"ID":"e9988a04-8333-4c15-91b9-bf93b1d1bdd9","Type":"ContainerStarted","Data":"7194de6e1d4d4fd6d92b64eb6b5f949a27b689effef3c02563b1ec99d28358f0"} Jul 16 22:20:09.825262 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:09.825167 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lfgnf" event={"ID":"e9988a04-8333-4c15-91b9-bf93b1d1bdd9","Type":"ContainerStarted","Data":"3e228057fd0669075a32e3b5dc5a381e9a68d0e82b02160db573f56a972b7f73"} Jul 16 22:20:09.825262 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:09.825235 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lfgnf" event={"ID":"e9988a04-8333-4c15-91b9-bf93b1d1bdd9","Type":"ContainerStarted","Data":"745176a974a2aee66b95f5861913ad8704bb7a41c7359b3add74058bb218ad24"} Jul 16 22:20:09.843248 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:09.843192 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lfgnf" podStartSLOduration=373.839962077 podStartE2EDuration="6m14.843174514s" totalImagesPullingTime="1.003212437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:20:09.841269085 +0000 UTC m=+375.943914329" watchObservedRunningTime="2026-07-16 22:20:09.843174514 +0000 UTC m=+375.945819739" Jul 16 22:20:11.841863 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:11.841834 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daaebddc-3869-4807-b254-b329abe2a07f","Type":"ContainerStarted","Data":"f150bb2bdee9fbd101a87fd411c90d1d9156d073a80fe5e774684d8d87fae0c6"} Jul 16 22:20:11.842161 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:11.841944 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daaebddc-3869-4807-b254-b329abe2a07f","Type":"ContainerStarted","Data":"525ca43bd4b1588b4bfd648a7195d1c0edd412e675c57ab9e1d290cb1c07e4bd"} Jul 16 22:20:12.849127 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:12.849086 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daaebddc-3869-4807-b254-b329abe2a07f","Type":"ContainerStarted","Data":"2d966e3c14e9f2be67eccaf2902cbab0c295cdb79eea1a2dbc457890ab26f5c5"} Jul 16 22:20:12.849540 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:12.849168 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daaebddc-3869-4807-b254-b329abe2a07f","Type":"ContainerStarted","Data":"51090fca6bed0eb1f661df01729e82529be425a91d0e56faca9e16fdef4a8c46"} Jul 16 22:20:12.849540 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:12.849210 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daaebddc-3869-4807-b254-b329abe2a07f","Type":"ContainerStarted","Data":"31152ab6759f8a6e0fc286b944355a224c854e1b59cb46f0b9c85977b0809e54"} Jul 16 22:20:12.849540 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:12.849249 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daaebddc-3869-4807-b254-b329abe2a07f","Type":"ContainerStarted","Data":"1e24a56df4680ab2a412e8d97b45c9817637edad7e3a9ebfed99615bdd24683f"} Jul 16 22:20:12.876397 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:12.876345 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.972681404 podStartE2EDuration="4.876329826s" totalImagesPullingTime="2.88810995s" totalInitContainerRuntime="15.538472ms" isStatefulPod=false podCreationTimestamp="2026-07-16 22:20:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:20:12.873614139 +0000 UTC m=+378.976259366" watchObservedRunningTime="2026-07-16 22:20:12.876329826 +0000 UTC m=+378.978975051" Jul 16 22:20:15.127639 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.127602 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c78689d94-49m6j"] Jul 16 22:20:15.129862 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.129842 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.133514 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.133491 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 22:20:15.134508 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.134486 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ct4lz\"" Jul 16 22:20:15.134618 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.134517 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 22:20:15.134618 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.134566 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 22:20:15.134917 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.134901 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 22:20:15.134994 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.134980 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 22:20:15.141351 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.141332 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 16 22:20:15.148608 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.148585 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c78689d94-49m6j"] Jul 16 22:20:15.217500 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.217470 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-service-ca\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.217617 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.217520 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/349b6068-95cd-4824-8ce3-59db83503415-console-oauth-config\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.217617 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.217545 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/349b6068-95cd-4824-8ce3-59db83503415-console-serving-cert\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.217617 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.217578 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-console-config\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.217748 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.217636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggxnk\" (UniqueName: \"kubernetes.io/projected/349b6068-95cd-4824-8ce3-59db83503415-kube-api-access-ggxnk\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.217748 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.217655 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-trusted-ca-bundle\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.217748 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.217671 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-oauth-serving-cert\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.319063 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.319027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-service-ca\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.319221 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.319100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/349b6068-95cd-4824-8ce3-59db83503415-console-oauth-config\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.319221 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.319130 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/349b6068-95cd-4824-8ce3-59db83503415-console-serving-cert\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.319221 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.319149 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-console-config\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.319221 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.319168 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggxnk\" (UniqueName: \"kubernetes.io/projected/349b6068-95cd-4824-8ce3-59db83503415-kube-api-access-ggxnk\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.319221 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.319187 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-trusted-ca-bundle\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.319221 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.319211 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-oauth-serving-cert\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.319884 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.319851 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-service-ca\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.319985 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.319887 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-console-config\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.319985 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.319942 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-oauth-serving-cert\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.319985 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.319974 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-trusted-ca-bundle\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.321603 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.321580 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/349b6068-95cd-4824-8ce3-59db83503415-console-oauth-config\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.321771 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.321750 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/349b6068-95cd-4824-8ce3-59db83503415-console-serving-cert\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.328291 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.328272 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggxnk\" (UniqueName: \"kubernetes.io/projected/349b6068-95cd-4824-8ce3-59db83503415-kube-api-access-ggxnk\") pod \"console-6c78689d94-49m6j\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.440430 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.440374 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:15.573143 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.573117 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c78689d94-49m6j"] Jul 16 22:20:15.575571 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:20:15.575549 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod349b6068_95cd_4824_8ce3_59db83503415.slice/crio-ab0d6579aeb827ef72499d6564684318795c6a3f34177cef284a2dee4dbbdb0c WatchSource:0}: Error finding container ab0d6579aeb827ef72499d6564684318795c6a3f34177cef284a2dee4dbbdb0c: Status 404 returned error can't find the container with id ab0d6579aeb827ef72499d6564684318795c6a3f34177cef284a2dee4dbbdb0c Jul 16 22:20:15.863199 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.863166 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c78689d94-49m6j" event={"ID":"349b6068-95cd-4824-8ce3-59db83503415","Type":"ContainerStarted","Data":"44d806651cd7664749f6be053b61c1817209737932ba70971e5fafe8f5b4c7cc"} Jul 16 22:20:15.863355 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:15.863220 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c78689d94-49m6j" event={"ID":"349b6068-95cd-4824-8ce3-59db83503415","Type":"ContainerStarted","Data":"ab0d6579aeb827ef72499d6564684318795c6a3f34177cef284a2dee4dbbdb0c"} Jul 16 22:20:25.441218 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:25.441178 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:25.441673 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:25.441244 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:25.445829 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:25.445807 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:25.464770 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:25.464724 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c78689d94-49m6j" podStartSLOduration=10.464711026 podStartE2EDuration="10.464711026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:20:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:20:15.882858157 +0000 UTC m=+381.985503383" watchObservedRunningTime="2026-07-16 22:20:25.464711026 +0000 UTC m=+391.567356251" Jul 16 22:20:25.908697 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:25.908619 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:20:56.326085 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:56.326047 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk"] Jul 16 22:20:56.328545 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:56.328528 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk" Jul 16 22:20:56.331334 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:56.331310 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 16 22:20:56.331507 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:56.331488 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nqpbq\"" Jul 16 22:20:56.332672 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:56.332651 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 16 22:20:56.342818 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:56.342795 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk"] Jul 16 22:20:56.361027 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:56.361001 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64a2b83a-06df-4089-af28-1fc2854757a2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk\" (UID: \"64a2b83a-06df-4089-af28-1fc2854757a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk" Jul 16 22:20:56.361139 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:56.361034 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf78m\" (UniqueName: \"kubernetes.io/projected/64a2b83a-06df-4089-af28-1fc2854757a2-kube-api-access-hf78m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk\" (UID: \"64a2b83a-06df-4089-af28-1fc2854757a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk" Jul 16 22:20:56.361139 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:56.361090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64a2b83a-06df-4089-af28-1fc2854757a2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk\" (UID: \"64a2b83a-06df-4089-af28-1fc2854757a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk" Jul 16 22:20:56.462219 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:56.462174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64a2b83a-06df-4089-af28-1fc2854757a2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk\" (UID: \"64a2b83a-06df-4089-af28-1fc2854757a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk" Jul 16 22:20:56.462412 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:56.462232 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf78m\" (UniqueName: \"kubernetes.io/projected/64a2b83a-06df-4089-af28-1fc2854757a2-kube-api-access-hf78m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk\" (UID: \"64a2b83a-06df-4089-af28-1fc2854757a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk" Jul 16 22:20:56.462412 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:56.462291 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64a2b83a-06df-4089-af28-1fc2854757a2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk\" (UID: \"64a2b83a-06df-4089-af28-1fc2854757a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk" Jul 16 22:20:56.462603 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:56.462587 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64a2b83a-06df-4089-af28-1fc2854757a2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk\" (UID: \"64a2b83a-06df-4089-af28-1fc2854757a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk" Jul 16 22:20:56.462639 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:56.462621 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64a2b83a-06df-4089-af28-1fc2854757a2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk\" (UID: \"64a2b83a-06df-4089-af28-1fc2854757a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk" Jul 16 22:20:56.470823 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:56.470788 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf78m\" (UniqueName: \"kubernetes.io/projected/64a2b83a-06df-4089-af28-1fc2854757a2-kube-api-access-hf78m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk\" (UID: \"64a2b83a-06df-4089-af28-1fc2854757a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk" Jul 16 22:20:56.637160 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:56.637058 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk" Jul 16 22:20:56.762397 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:56.762365 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk"] Jul 16 22:20:56.764185 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:20:56.764156 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a2b83a_06df_4089_af28_1fc2854757a2.slice/crio-23b108e43cae1bcc3f63c525d679ed0edfffa05e2523af812a20e01556372285 WatchSource:0}: Error finding container 23b108e43cae1bcc3f63c525d679ed0edfffa05e2523af812a20e01556372285: Status 404 returned error can't find the container with id 23b108e43cae1bcc3f63c525d679ed0edfffa05e2523af812a20e01556372285 Jul 16 22:20:57.033287 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:20:57.033256 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk" event={"ID":"64a2b83a-06df-4089-af28-1fc2854757a2","Type":"ContainerStarted","Data":"23b108e43cae1bcc3f63c525d679ed0edfffa05e2523af812a20e01556372285"} Jul 16 22:21:03.060220 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:03.060187 2578 generic.go:356] "Generic (PLEG): container finished" podID="64a2b83a-06df-4089-af28-1fc2854757a2" containerID="3a67de65ac9f879a3bc6bf2ff2e2d877ce934403e6af1b284888336ab827d2a1" exitCode=0 Jul 16 22:21:03.060569 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:03.060232 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk" event={"ID":"64a2b83a-06df-4089-af28-1fc2854757a2","Type":"ContainerDied","Data":"3a67de65ac9f879a3bc6bf2ff2e2d877ce934403e6af1b284888336ab827d2a1"} Jul 16 22:21:06.074087 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:06.074042 2578 generic.go:356] "Generic (PLEG): container finished" podID="64a2b83a-06df-4089-af28-1fc2854757a2" containerID="9a16ba355f5b50b501c68d1fcbb8fc4553c5a354402e1dacbeb5fc17d117fd3c" exitCode=0 Jul 16 22:21:06.074523 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:06.074106 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk" event={"ID":"64a2b83a-06df-4089-af28-1fc2854757a2","Type":"ContainerDied","Data":"9a16ba355f5b50b501c68d1fcbb8fc4553c5a354402e1dacbeb5fc17d117fd3c"} Jul 16 22:21:13.109100 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:13.108990 2578 generic.go:356] "Generic (PLEG): container finished" podID="64a2b83a-06df-4089-af28-1fc2854757a2" containerID="cafb820ef7e09752756624a551618df3bccf771aa08c44c56a6dca0382d50903" exitCode=0 Jul 16 22:21:13.109100 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:13.109089 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk" event={"ID":"64a2b83a-06df-4089-af28-1fc2854757a2","Type":"ContainerDied","Data":"cafb820ef7e09752756624a551618df3bccf771aa08c44c56a6dca0382d50903"} Jul 16 22:21:14.238839 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:14.238814 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk" Jul 16 22:21:14.335623 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:14.335584 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hf78m\" (UniqueName: \"kubernetes.io/projected/64a2b83a-06df-4089-af28-1fc2854757a2-kube-api-access-hf78m\") pod \"64a2b83a-06df-4089-af28-1fc2854757a2\" (UID: \"64a2b83a-06df-4089-af28-1fc2854757a2\") " Jul 16 22:21:14.335795 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:14.335645 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64a2b83a-06df-4089-af28-1fc2854757a2-bundle\") pod \"64a2b83a-06df-4089-af28-1fc2854757a2\" (UID: \"64a2b83a-06df-4089-af28-1fc2854757a2\") " Jul 16 22:21:14.335795 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:14.335671 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64a2b83a-06df-4089-af28-1fc2854757a2-util\") pod \"64a2b83a-06df-4089-af28-1fc2854757a2\" (UID: \"64a2b83a-06df-4089-af28-1fc2854757a2\") " Jul 16 22:21:14.336344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:14.336316 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64a2b83a-06df-4089-af28-1fc2854757a2-bundle" (OuterVolumeSpecName: "bundle") pod "64a2b83a-06df-4089-af28-1fc2854757a2" (UID: "64a2b83a-06df-4089-af28-1fc2854757a2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:21:14.337781 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:14.337756 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64a2b83a-06df-4089-af28-1fc2854757a2-kube-api-access-hf78m" (OuterVolumeSpecName: "kube-api-access-hf78m") pod "64a2b83a-06df-4089-af28-1fc2854757a2" (UID: "64a2b83a-06df-4089-af28-1fc2854757a2"). InnerVolumeSpecName "kube-api-access-hf78m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:21:14.339694 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:14.339671 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64a2b83a-06df-4089-af28-1fc2854757a2-util" (OuterVolumeSpecName: "util") pod "64a2b83a-06df-4089-af28-1fc2854757a2" (UID: "64a2b83a-06df-4089-af28-1fc2854757a2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:21:14.436386 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:14.436326 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hf78m\" (UniqueName: \"kubernetes.io/projected/64a2b83a-06df-4089-af28-1fc2854757a2-kube-api-access-hf78m\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:21:14.436386 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:14.436347 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64a2b83a-06df-4089-af28-1fc2854757a2-bundle\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:21:14.436386 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:14.436357 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64a2b83a-06df-4089-af28-1fc2854757a2-util\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:21:15.118573 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:15.118544 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk" Jul 16 22:21:15.118739 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:15.118544 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n7gdk" event={"ID":"64a2b83a-06df-4089-af28-1fc2854757a2","Type":"ContainerDied","Data":"23b108e43cae1bcc3f63c525d679ed0edfffa05e2523af812a20e01556372285"} Jul 16 22:21:15.118739 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:15.118670 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23b108e43cae1bcc3f63c525d679ed0edfffa05e2523af812a20e01556372285" Jul 16 22:21:19.265132 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.265093 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mttgf"] Jul 16 22:21:19.265540 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.265419 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64a2b83a-06df-4089-af28-1fc2854757a2" containerName="extract" Jul 16 22:21:19.265540 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.265430 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="64a2b83a-06df-4089-af28-1fc2854757a2" containerName="extract" Jul 16 22:21:19.265540 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.265456 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64a2b83a-06df-4089-af28-1fc2854757a2" containerName="util" Jul 16 22:21:19.265540 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.265462 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="64a2b83a-06df-4089-af28-1fc2854757a2" containerName="util" Jul 16 22:21:19.265540 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.265468 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64a2b83a-06df-4089-af28-1fc2854757a2" containerName="pull" Jul 16 22:21:19.265540 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.265474 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="64a2b83a-06df-4089-af28-1fc2854757a2" containerName="pull" Jul 16 22:21:19.265540 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.265526 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="64a2b83a-06df-4089-af28-1fc2854757a2" containerName="extract" Jul 16 22:21:19.309270 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.309239 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mttgf"] Jul 16 22:21:19.309420 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.309345 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mttgf" Jul 16 22:21:19.312583 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.312555 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 16 22:21:19.312757 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.312591 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 16 22:21:19.312757 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.312720 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-62vr5\"" Jul 16 22:21:19.378188 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.378151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5c733c9-17a3-4a02-88c7-4623ef1ac405-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mttgf\" (UID: \"f5c733c9-17a3-4a02-88c7-4623ef1ac405\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mttgf" Jul 16 22:21:19.378366 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.378239 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9gtq\" (UniqueName: \"kubernetes.io/projected/f5c733c9-17a3-4a02-88c7-4623ef1ac405-kube-api-access-z9gtq\") pod \"cert-manager-operator-controller-manager-55c444bf86-mttgf\" (UID: \"f5c733c9-17a3-4a02-88c7-4623ef1ac405\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mttgf" Jul 16 22:21:19.479632 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.479593 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9gtq\" (UniqueName: \"kubernetes.io/projected/f5c733c9-17a3-4a02-88c7-4623ef1ac405-kube-api-access-z9gtq\") pod \"cert-manager-operator-controller-manager-55c444bf86-mttgf\" (UID: \"f5c733c9-17a3-4a02-88c7-4623ef1ac405\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mttgf" Jul 16 22:21:19.479783 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.479649 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5c733c9-17a3-4a02-88c7-4623ef1ac405-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mttgf\" (UID: \"f5c733c9-17a3-4a02-88c7-4623ef1ac405\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mttgf" Jul 16 22:21:19.479979 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.479963 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5c733c9-17a3-4a02-88c7-4623ef1ac405-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mttgf\" (UID: \"f5c733c9-17a3-4a02-88c7-4623ef1ac405\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mttgf" Jul 16 22:21:19.494365 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.494337 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9gtq\" (UniqueName: \"kubernetes.io/projected/f5c733c9-17a3-4a02-88c7-4623ef1ac405-kube-api-access-z9gtq\") pod \"cert-manager-operator-controller-manager-55c444bf86-mttgf\" (UID: \"f5c733c9-17a3-4a02-88c7-4623ef1ac405\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mttgf" Jul 16 22:21:19.617951 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.617887 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mttgf" Jul 16 22:21:19.776524 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:19.776498 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mttgf"] Jul 16 22:21:19.778872 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:21:19.778845 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c733c9_17a3_4a02_88c7_4623ef1ac405.slice/crio-c5432c060cdd4691848191f38399aab97e6bea25a9ee6444990d2fcc2d800407 WatchSource:0}: Error finding container c5432c060cdd4691848191f38399aab97e6bea25a9ee6444990d2fcc2d800407: Status 404 returned error can't find the container with id c5432c060cdd4691848191f38399aab97e6bea25a9ee6444990d2fcc2d800407 Jul 16 22:21:20.146186 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:20.141612 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mttgf" event={"ID":"f5c733c9-17a3-4a02-88c7-4623ef1ac405","Type":"ContainerStarted","Data":"c5432c060cdd4691848191f38399aab97e6bea25a9ee6444990d2fcc2d800407"} Jul 16 22:21:22.152537 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:22.152499 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mttgf" event={"ID":"f5c733c9-17a3-4a02-88c7-4623ef1ac405","Type":"ContainerStarted","Data":"dd87993da7b350c3f141c575b918e513571294baf3022a3778045635c807b4ea"} Jul 16 22:21:22.175426 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:22.175372 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mttgf" podStartSLOduration=1.279031603 podStartE2EDuration="3.175355966s" totalImagesPullingTime="1.896324363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:21:22.174042176 +0000 UTC m=+448.276687419" watchObservedRunningTime="2026-07-16 22:21:22.175355966 +0000 UTC m=+448.278001192" Jul 16 22:21:22.924035 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:22.923998 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gsk88"] Jul 16 22:21:22.938935 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:22.938909 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gsk88" Jul 16 22:21:22.943520 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:22.943492 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-fz52z\"" Jul 16 22:21:22.943754 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:22.943739 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 16 22:21:22.943853 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:22.943776 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 16 22:21:22.946758 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:22.946739 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gsk88"] Jul 16 22:21:23.011498 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:23.011469 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5e63d9e-7e9b-4faa-94f7-ea4449a43e6f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gsk88\" (UID: \"e5e63d9e-7e9b-4faa-94f7-ea4449a43e6f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gsk88" Jul 16 22:21:23.011638 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:23.011531 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh4bh\" (UniqueName: \"kubernetes.io/projected/e5e63d9e-7e9b-4faa-94f7-ea4449a43e6f-kube-api-access-rh4bh\") pod \"cert-manager-webhook-6486ffd997-gsk88\" (UID: \"e5e63d9e-7e9b-4faa-94f7-ea4449a43e6f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gsk88" Jul 16 22:21:23.112782 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:23.112757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh4bh\" (UniqueName: \"kubernetes.io/projected/e5e63d9e-7e9b-4faa-94f7-ea4449a43e6f-kube-api-access-rh4bh\") pod \"cert-manager-webhook-6486ffd997-gsk88\" (UID: \"e5e63d9e-7e9b-4faa-94f7-ea4449a43e6f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gsk88" Jul 16 22:21:23.112922 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:23.112809 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5e63d9e-7e9b-4faa-94f7-ea4449a43e6f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gsk88\" (UID: \"e5e63d9e-7e9b-4faa-94f7-ea4449a43e6f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gsk88" Jul 16 22:21:23.125802 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:23.125773 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh4bh\" (UniqueName: \"kubernetes.io/projected/e5e63d9e-7e9b-4faa-94f7-ea4449a43e6f-kube-api-access-rh4bh\") pod \"cert-manager-webhook-6486ffd997-gsk88\" (UID: \"e5e63d9e-7e9b-4faa-94f7-ea4449a43e6f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gsk88" Jul 16 22:21:23.142978 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:23.142945 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5e63d9e-7e9b-4faa-94f7-ea4449a43e6f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gsk88\" (UID: \"e5e63d9e-7e9b-4faa-94f7-ea4449a43e6f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gsk88" Jul 16 22:21:23.259309 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:23.259277 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gsk88" Jul 16 22:21:23.412172 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:23.412146 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gsk88"] Jul 16 22:21:23.414647 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:21:23.414616 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5e63d9e_7e9b_4faa_94f7_ea4449a43e6f.slice/crio-3af835a332babb2cadcff2267d020c4565120b7d9c4c1f172552c46f7542494c WatchSource:0}: Error finding container 3af835a332babb2cadcff2267d020c4565120b7d9c4c1f172552c46f7542494c: Status 404 returned error can't find the container with id 3af835a332babb2cadcff2267d020c4565120b7d9c4c1f172552c46f7542494c Jul 16 22:21:24.164933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:24.164897 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gsk88" event={"ID":"e5e63d9e-7e9b-4faa-94f7-ea4449a43e6f","Type":"ContainerStarted","Data":"3af835a332babb2cadcff2267d020c4565120b7d9c4c1f172552c46f7542494c"} Jul 16 22:21:27.182177 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:27.182139 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gsk88" event={"ID":"e5e63d9e-7e9b-4faa-94f7-ea4449a43e6f","Type":"ContainerStarted","Data":"f959bb76f9d85de9494eb4838b1280d0159a1f6ae99a7ea28223d634dbb59fde"} Jul 16 22:21:27.182580 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:27.182213 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gsk88" Jul 16 22:21:27.200344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:27.200300 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-gsk88" podStartSLOduration=2.400025437 podStartE2EDuration="5.200285125s" totalImagesPullingTime="2.800259688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:21:27.199189778 +0000 UTC m=+453.301835003" watchObservedRunningTime="2026-07-16 22:21:27.200285125 +0000 UTC m=+453.302930351" Jul 16 22:21:27.826844 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:27.826806 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-c2552"] Jul 16 22:21:27.829317 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:27.829294 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c2552" Jul 16 22:21:27.832438 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:27.832413 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-sh4j4\"" Jul 16 22:21:27.838522 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:27.838494 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-c2552"] Jul 16 22:21:27.957149 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:27.957113 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3be5837f-30e5-4244-b403-d8a9045b24ed-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-c2552\" (UID: \"3be5837f-30e5-4244-b403-d8a9045b24ed\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c2552" Jul 16 22:21:27.957302 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:27.957153 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4tc5\" (UniqueName: \"kubernetes.io/projected/3be5837f-30e5-4244-b403-d8a9045b24ed-kube-api-access-z4tc5\") pod \"cert-manager-cainjector-559cdd8c87-c2552\" (UID: \"3be5837f-30e5-4244-b403-d8a9045b24ed\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c2552" Jul 16 22:21:28.058332 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:28.058301 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3be5837f-30e5-4244-b403-d8a9045b24ed-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-c2552\" (UID: \"3be5837f-30e5-4244-b403-d8a9045b24ed\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c2552" Jul 16 22:21:28.058475 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:28.058336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4tc5\" (UniqueName: \"kubernetes.io/projected/3be5837f-30e5-4244-b403-d8a9045b24ed-kube-api-access-z4tc5\") pod \"cert-manager-cainjector-559cdd8c87-c2552\" (UID: \"3be5837f-30e5-4244-b403-d8a9045b24ed\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c2552" Jul 16 22:21:28.066586 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:28.066556 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3be5837f-30e5-4244-b403-d8a9045b24ed-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-c2552\" (UID: \"3be5837f-30e5-4244-b403-d8a9045b24ed\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c2552" Jul 16 22:21:28.066694 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:28.066570 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4tc5\" (UniqueName: \"kubernetes.io/projected/3be5837f-30e5-4244-b403-d8a9045b24ed-kube-api-access-z4tc5\") pod \"cert-manager-cainjector-559cdd8c87-c2552\" (UID: \"3be5837f-30e5-4244-b403-d8a9045b24ed\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c2552" Jul 16 22:21:28.139562 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:28.139491 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c2552" Jul 16 22:21:28.269065 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:28.269041 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-c2552"] Jul 16 22:21:28.271032 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:21:28.271010 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3be5837f_30e5_4244_b403_d8a9045b24ed.slice/crio-83e2c73bb8e2e74ce8b9a658290fa172945dcb87f42beb6db73f6770993b8194 WatchSource:0}: Error finding container 83e2c73bb8e2e74ce8b9a658290fa172945dcb87f42beb6db73f6770993b8194: Status 404 returned error can't find the container with id 83e2c73bb8e2e74ce8b9a658290fa172945dcb87f42beb6db73f6770993b8194 Jul 16 22:21:29.192843 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:29.192809 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c2552" event={"ID":"3be5837f-30e5-4244-b403-d8a9045b24ed","Type":"ContainerStarted","Data":"74086cd0f7d55073568f192fba45b383b21dad014b5b33d64e6ba5e50ae32d75"} Jul 16 22:21:29.192843 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:29.192849 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c2552" event={"ID":"3be5837f-30e5-4244-b403-d8a9045b24ed","Type":"ContainerStarted","Data":"83e2c73bb8e2e74ce8b9a658290fa172945dcb87f42beb6db73f6770993b8194"} Jul 16 22:21:29.209477 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:29.209427 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c2552" podStartSLOduration=2.209412175 podStartE2EDuration="2.209412175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:21:29.208806934 +0000 UTC m=+455.311452162" watchObservedRunningTime="2026-07-16 22:21:29.209412175 +0000 UTC m=+455.312057401" Jul 16 22:21:33.189272 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:33.189237 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gsk88" Jul 16 22:21:34.430080 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:34.430048 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kltwn"] Jul 16 22:21:34.432415 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:34.432397 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kltwn" Jul 16 22:21:34.435128 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:34.435100 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-sr5zz\"" Jul 16 22:21:34.446400 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:34.446361 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kltwn"] Jul 16 22:21:34.620814 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:34.620779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2e6764b-39a1-42c3-942a-3aa65d520ac8-bound-sa-token\") pod \"cert-manager-55b4d954d5-kltwn\" (UID: \"d2e6764b-39a1-42c3-942a-3aa65d520ac8\") " pod="cert-manager/cert-manager-55b4d954d5-kltwn" Jul 16 22:21:34.620988 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:34.620840 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn7sx\" (UniqueName: \"kubernetes.io/projected/d2e6764b-39a1-42c3-942a-3aa65d520ac8-kube-api-access-tn7sx\") pod \"cert-manager-55b4d954d5-kltwn\" (UID: \"d2e6764b-39a1-42c3-942a-3aa65d520ac8\") " pod="cert-manager/cert-manager-55b4d954d5-kltwn" Jul 16 22:21:34.721883 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:34.721849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn7sx\" (UniqueName: \"kubernetes.io/projected/d2e6764b-39a1-42c3-942a-3aa65d520ac8-kube-api-access-tn7sx\") pod \"cert-manager-55b4d954d5-kltwn\" (UID: \"d2e6764b-39a1-42c3-942a-3aa65d520ac8\") " pod="cert-manager/cert-manager-55b4d954d5-kltwn" Jul 16 22:21:34.722058 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:34.721946 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2e6764b-39a1-42c3-942a-3aa65d520ac8-bound-sa-token\") pod \"cert-manager-55b4d954d5-kltwn\" (UID: \"d2e6764b-39a1-42c3-942a-3aa65d520ac8\") " pod="cert-manager/cert-manager-55b4d954d5-kltwn" Jul 16 22:21:34.730957 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:34.730923 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2e6764b-39a1-42c3-942a-3aa65d520ac8-bound-sa-token\") pod \"cert-manager-55b4d954d5-kltwn\" (UID: \"d2e6764b-39a1-42c3-942a-3aa65d520ac8\") " pod="cert-manager/cert-manager-55b4d954d5-kltwn" Jul 16 22:21:34.731107 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:34.731052 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn7sx\" (UniqueName: \"kubernetes.io/projected/d2e6764b-39a1-42c3-942a-3aa65d520ac8-kube-api-access-tn7sx\") pod \"cert-manager-55b4d954d5-kltwn\" (UID: \"d2e6764b-39a1-42c3-942a-3aa65d520ac8\") " pod="cert-manager/cert-manager-55b4d954d5-kltwn" Jul 16 22:21:34.747821 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:34.747799 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kltwn" Jul 16 22:21:34.878773 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:34.878746 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kltwn"] Jul 16 22:21:34.880647 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:21:34.880617 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2e6764b_39a1_42c3_942a_3aa65d520ac8.slice/crio-edc03d397e70426ccecbd4033d5249e96f994be97ef8dc263185b31d669274bb WatchSource:0}: Error finding container edc03d397e70426ccecbd4033d5249e96f994be97ef8dc263185b31d669274bb: Status 404 returned error can't find the container with id edc03d397e70426ccecbd4033d5249e96f994be97ef8dc263185b31d669274bb Jul 16 22:21:35.220416 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:35.220380 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kltwn" event={"ID":"d2e6764b-39a1-42c3-942a-3aa65d520ac8","Type":"ContainerStarted","Data":"317266bd2f6a4b893e3d3cfd14aa136a613cdd3827fba48afe11af617c81f94f"} Jul 16 22:21:35.220416 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:21:35.220423 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kltwn" event={"ID":"d2e6764b-39a1-42c3-942a-3aa65d520ac8","Type":"ContainerStarted","Data":"edc03d397e70426ccecbd4033d5249e96f994be97ef8dc263185b31d669274bb"} Jul 16 22:22:04.211646 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.211580 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-kltwn" podStartSLOduration=30.211557976 podStartE2EDuration="30.211557976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:21:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:21:35.236760701 +0000 UTC m=+461.339405926" watchObservedRunningTime="2026-07-16 22:22:04.211557976 +0000 UTC m=+490.314203203" Jul 16 22:22:04.213013 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.212992 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5"] Jul 16 22:22:04.216132 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.216116 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5" Jul 16 22:22:04.221942 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.221917 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 16 22:22:04.222106 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.221974 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jqctg\"" Jul 16 22:22:04.222106 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.222041 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 16 22:22:04.222106 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.222101 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 16 22:22:04.222315 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.222294 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 16 22:22:04.222541 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.222522 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 16 22:22:04.231479 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.231457 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5"] Jul 16 22:22:04.282843 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.282799 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/da0c4665-973f-46c3-a069-2f6cb4e3b84a-manager-config\") pod \"lws-controller-manager-f787d6dbd-qhtf5\" (UID: \"da0c4665-973f-46c3-a069-2f6cb4e3b84a\") " pod="openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5" Jul 16 22:22:04.283051 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.282912 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4g8z\" (UniqueName: \"kubernetes.io/projected/da0c4665-973f-46c3-a069-2f6cb4e3b84a-kube-api-access-w4g8z\") pod \"lws-controller-manager-f787d6dbd-qhtf5\" (UID: \"da0c4665-973f-46c3-a069-2f6cb4e3b84a\") " pod="openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5" Jul 16 22:22:04.283051 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.283005 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da0c4665-973f-46c3-a069-2f6cb4e3b84a-cert\") pod \"lws-controller-manager-f787d6dbd-qhtf5\" (UID: \"da0c4665-973f-46c3-a069-2f6cb4e3b84a\") " pod="openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5" Jul 16 22:22:04.283216 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.283039 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/da0c4665-973f-46c3-a069-2f6cb4e3b84a-metrics-cert\") pod \"lws-controller-manager-f787d6dbd-qhtf5\" (UID: \"da0c4665-973f-46c3-a069-2f6cb4e3b84a\") " pod="openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5" Jul 16 22:22:04.383729 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.383696 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4g8z\" (UniqueName: \"kubernetes.io/projected/da0c4665-973f-46c3-a069-2f6cb4e3b84a-kube-api-access-w4g8z\") pod \"lws-controller-manager-f787d6dbd-qhtf5\" (UID: \"da0c4665-973f-46c3-a069-2f6cb4e3b84a\") " pod="openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5" Jul 16 22:22:04.383923 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.383755 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da0c4665-973f-46c3-a069-2f6cb4e3b84a-cert\") pod \"lws-controller-manager-f787d6dbd-qhtf5\" (UID: \"da0c4665-973f-46c3-a069-2f6cb4e3b84a\") " pod="openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5" Jul 16 22:22:04.383923 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.383774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/da0c4665-973f-46c3-a069-2f6cb4e3b84a-metrics-cert\") pod \"lws-controller-manager-f787d6dbd-qhtf5\" (UID: \"da0c4665-973f-46c3-a069-2f6cb4e3b84a\") " pod="openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5" Jul 16 22:22:04.383923 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.383804 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/da0c4665-973f-46c3-a069-2f6cb4e3b84a-manager-config\") pod \"lws-controller-manager-f787d6dbd-qhtf5\" (UID: \"da0c4665-973f-46c3-a069-2f6cb4e3b84a\") " pod="openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5" Jul 16 22:22:04.384442 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.384417 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/da0c4665-973f-46c3-a069-2f6cb4e3b84a-manager-config\") pod \"lws-controller-manager-f787d6dbd-qhtf5\" (UID: \"da0c4665-973f-46c3-a069-2f6cb4e3b84a\") " pod="openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5" Jul 16 22:22:04.386222 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.386193 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da0c4665-973f-46c3-a069-2f6cb4e3b84a-cert\") pod \"lws-controller-manager-f787d6dbd-qhtf5\" (UID: \"da0c4665-973f-46c3-a069-2f6cb4e3b84a\") " pod="openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5" Jul 16 22:22:04.386336 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.386307 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/da0c4665-973f-46c3-a069-2f6cb4e3b84a-metrics-cert\") pod \"lws-controller-manager-f787d6dbd-qhtf5\" (UID: \"da0c4665-973f-46c3-a069-2f6cb4e3b84a\") " pod="openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5" Jul 16 22:22:04.399827 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.399805 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4g8z\" (UniqueName: \"kubernetes.io/projected/da0c4665-973f-46c3-a069-2f6cb4e3b84a-kube-api-access-w4g8z\") pod \"lws-controller-manager-f787d6dbd-qhtf5\" (UID: \"da0c4665-973f-46c3-a069-2f6cb4e3b84a\") " pod="openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5" Jul 16 22:22:04.525429 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.525347 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5" Jul 16 22:22:04.658423 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:04.658397 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5"] Jul 16 22:22:04.660611 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:22:04.660588 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda0c4665_973f_46c3_a069_2f6cb4e3b84a.slice/crio-1a72759ccc17eabf419925e2a9f72e0052b8753abc63a9774e904ea66ea39ce0 WatchSource:0}: Error finding container 1a72759ccc17eabf419925e2a9f72e0052b8753abc63a9774e904ea66ea39ce0: Status 404 returned error can't find the container with id 1a72759ccc17eabf419925e2a9f72e0052b8753abc63a9774e904ea66ea39ce0 Jul 16 22:22:05.365436 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:05.365395 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5" event={"ID":"da0c4665-973f-46c3-a069-2f6cb4e3b84a","Type":"ContainerStarted","Data":"1a72759ccc17eabf419925e2a9f72e0052b8753abc63a9774e904ea66ea39ce0"} Jul 16 22:22:06.555700 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.555662 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68"] Jul 16 22:22:06.566113 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.566065 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" Jul 16 22:22:06.570251 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.570220 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 16 22:22:06.570404 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.570345 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4psbw\"" Jul 16 22:22:06.570582 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.570562 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 16 22:22:06.570851 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.570827 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 16 22:22:06.570955 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.570833 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 16 22:22:06.584506 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.584470 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68"] Jul 16 22:22:06.705136 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.705094 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0-manifests\") pod \"opendatahub-operator-controller-manager-7846b6849-hww68\" (UID: \"bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" Jul 16 22:22:06.705136 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.705132 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7846b6849-hww68\" (UID: \"bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" Jul 16 22:22:06.705371 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.705179 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0-webhook-cert\") pod \"opendatahub-operator-controller-manager-7846b6849-hww68\" (UID: \"bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" Jul 16 22:22:06.705371 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.705291 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0-tmp\") pod \"opendatahub-operator-controller-manager-7846b6849-hww68\" (UID: \"bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" Jul 16 22:22:06.705371 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.705333 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v55b8\" (UniqueName: \"kubernetes.io/projected/bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0-kube-api-access-v55b8\") pod \"opendatahub-operator-controller-manager-7846b6849-hww68\" (UID: \"bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" Jul 16 22:22:06.806840 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.806752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0-manifests\") pod \"opendatahub-operator-controller-manager-7846b6849-hww68\" (UID: \"bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" Jul 16 22:22:06.806840 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.806799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7846b6849-hww68\" (UID: \"bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" Jul 16 22:22:06.807064 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.806847 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0-webhook-cert\") pod \"opendatahub-operator-controller-manager-7846b6849-hww68\" (UID: \"bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" Jul 16 22:22:06.807064 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.806902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0-tmp\") pod \"opendatahub-operator-controller-manager-7846b6849-hww68\" (UID: \"bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" Jul 16 22:22:06.807064 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.806931 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v55b8\" (UniqueName: \"kubernetes.io/projected/bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0-kube-api-access-v55b8\") pod \"opendatahub-operator-controller-manager-7846b6849-hww68\" (UID: \"bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" Jul 16 22:22:06.807266 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.807206 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0-manifests\") pod \"opendatahub-operator-controller-manager-7846b6849-hww68\" (UID: \"bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" Jul 16 22:22:06.809632 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.809611 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0-tmp\") pod \"opendatahub-operator-controller-manager-7846b6849-hww68\" (UID: \"bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" Jul 16 22:22:06.809768 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.809703 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7846b6849-hww68\" (UID: \"bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" Jul 16 22:22:06.809831 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.809768 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0-webhook-cert\") pod \"opendatahub-operator-controller-manager-7846b6849-hww68\" (UID: \"bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" Jul 16 22:22:06.822039 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.822011 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v55b8\" (UniqueName: \"kubernetes.io/projected/bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0-kube-api-access-v55b8\") pod \"opendatahub-operator-controller-manager-7846b6849-hww68\" (UID: \"bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" Jul 16 22:22:06.878582 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:06.878542 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" Jul 16 22:22:07.200934 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:07.200908 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68"] Jul 16 22:22:07.202056 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:22:07.202026 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd23c2f_2e16_4c57_b02c_fe7c7f955ff0.slice/crio-188ed9f5490561d070efe068a0a610617df7d7cdaf65f60ecc00892488dbedc0 WatchSource:0}: Error finding container 188ed9f5490561d070efe068a0a610617df7d7cdaf65f60ecc00892488dbedc0: Status 404 returned error can't find the container with id 188ed9f5490561d070efe068a0a610617df7d7cdaf65f60ecc00892488dbedc0 Jul 16 22:22:07.376457 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:07.376367 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" event={"ID":"bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0","Type":"ContainerStarted","Data":"188ed9f5490561d070efe068a0a610617df7d7cdaf65f60ecc00892488dbedc0"} Jul 16 22:22:07.379016 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:07.378980 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5" event={"ID":"da0c4665-973f-46c3-a069-2f6cb4e3b84a","Type":"ContainerStarted","Data":"6ba78f9d469c5e0e9a96a951a8727a695e8e15aecc6b4bb727ffbf786c393b3e"} Jul 16 22:22:07.379217 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:07.379190 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5" Jul 16 22:22:07.410684 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:07.410630 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5" podStartSLOduration=0.951621974 podStartE2EDuration="3.410613576s" totalImagesPullingTime="2.458991602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:22:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:22:07.409623531 +0000 UTC m=+493.512268772" watchObservedRunningTime="2026-07-16 22:22:07.410613576 +0000 UTC m=+493.513258802" Jul 16 22:22:10.395877 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:10.395793 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" event={"ID":"bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0","Type":"ContainerStarted","Data":"d41b86826847338845888e867a37aa9cd86d0462a6b9415c23a70f6f2bd715cc"} Jul 16 22:22:11.402530 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:11.402437 2578 generic.go:356] "Generic (PLEG): container finished" podID="bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0" containerID="d41b86826847338845888e867a37aa9cd86d0462a6b9415c23a70f6f2bd715cc" exitCode=0 Jul 16 22:22:11.402910 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:11.402528 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" event={"ID":"bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0","Type":"ContainerDied","Data":"d41b86826847338845888e867a37aa9cd86d0462a6b9415c23a70f6f2bd715cc"} Jul 16 22:22:12.409190 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:12.409097 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" event={"ID":"bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0","Type":"ContainerStarted","Data":"a99651ee0dbbad3888830b7c88cdc33900987355b50f96104779869e9e644071"} Jul 16 22:22:12.409639 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:12.409252 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" Jul 16 22:22:12.432159 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:12.432109 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" podStartSLOduration=2.004086872 podStartE2EDuration="6.432094998s" totalImagesPullingTime="3.355922188s" totalInitContainerRuntime="1.072085938s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:22:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:22:12.431669071 +0000 UTC m=+498.534314332" watchObservedRunningTime="2026-07-16 22:22:12.432094998 +0000 UTC m=+498.534740215" Jul 16 22:22:18.387578 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:18.387544 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-f787d6dbd-qhtf5" Jul 16 22:22:23.416606 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:23.416575 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-hww68" Jul 16 22:22:33.941177 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:33.941145 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2"] Jul 16 22:22:33.950148 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:33.950125 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:33.953346 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:33.953320 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-ttm4c\"" Jul 16 22:22:33.953472 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:33.953455 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 16 22:22:33.953532 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:33.953518 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 16 22:22:33.953876 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:33.953855 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 16 22:22:33.963413 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:33.963389 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2"] Jul 16 22:22:34.051055 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.051022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/257a6c02-856b-42bc-a76d-94e92163d7de-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.051055 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.051059 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/257a6c02-856b-42bc-a76d-94e92163d7de-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.051315 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.051194 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/257a6c02-856b-42bc-a76d-94e92163d7de-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.051315 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.051235 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/257a6c02-856b-42bc-a76d-94e92163d7de-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.051315 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.051285 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sxm9\" (UniqueName: \"kubernetes.io/projected/257a6c02-856b-42bc-a76d-94e92163d7de-kube-api-access-4sxm9\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.051446 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.051331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/257a6c02-856b-42bc-a76d-94e92163d7de-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.051446 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.051366 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/257a6c02-856b-42bc-a76d-94e92163d7de-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.051446 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.051398 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/257a6c02-856b-42bc-a76d-94e92163d7de-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.051446 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.051414 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/257a6c02-856b-42bc-a76d-94e92163d7de-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.152811 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.152761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/257a6c02-856b-42bc-a76d-94e92163d7de-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.152811 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.152817 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/257a6c02-856b-42bc-a76d-94e92163d7de-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.153054 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.152894 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/257a6c02-856b-42bc-a76d-94e92163d7de-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.153054 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.152918 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/257a6c02-856b-42bc-a76d-94e92163d7de-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.153054 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.152946 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sxm9\" (UniqueName: \"kubernetes.io/projected/257a6c02-856b-42bc-a76d-94e92163d7de-kube-api-access-4sxm9\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.153248 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.153100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/257a6c02-856b-42bc-a76d-94e92163d7de-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.153248 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.153186 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/257a6c02-856b-42bc-a76d-94e92163d7de-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.153248 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.153205 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/257a6c02-856b-42bc-a76d-94e92163d7de-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.153398 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.153259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/257a6c02-856b-42bc-a76d-94e92163d7de-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.153398 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.153277 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/257a6c02-856b-42bc-a76d-94e92163d7de-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.153398 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.153292 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/257a6c02-856b-42bc-a76d-94e92163d7de-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.153550 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.153472 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/257a6c02-856b-42bc-a76d-94e92163d7de-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.153550 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.153493 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/257a6c02-856b-42bc-a76d-94e92163d7de-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.153923 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.153901 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/257a6c02-856b-42bc-a76d-94e92163d7de-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.155320 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.155300 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/257a6c02-856b-42bc-a76d-94e92163d7de-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.155539 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.155524 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/257a6c02-856b-42bc-a76d-94e92163d7de-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.173846 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.173823 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/257a6c02-856b-42bc-a76d-94e92163d7de-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.175646 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.175629 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sxm9\" (UniqueName: \"kubernetes.io/projected/257a6c02-856b-42bc-a76d-94e92163d7de-kube-api-access-4sxm9\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lc7x2\" (UID: \"257a6c02-856b-42bc-a76d-94e92163d7de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.260357 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.260261 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:34.420772 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.420742 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2"] Jul 16 22:22:34.422724 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:22:34.422690 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod257a6c02_856b_42bc_a76d_94e92163d7de.slice/crio-65ade592a7f80593aebdec8ccc1e3e972d6d83ea4d1c8bd51dcfadaa9d0328f9 WatchSource:0}: Error finding container 65ade592a7f80593aebdec8ccc1e3e972d6d83ea4d1c8bd51dcfadaa9d0328f9: Status 404 returned error can't find the container with id 65ade592a7f80593aebdec8ccc1e3e972d6d83ea4d1c8bd51dcfadaa9d0328f9 Jul 16 22:22:34.513623 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:34.513540 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" event={"ID":"257a6c02-856b-42bc-a76d-94e92163d7de","Type":"ContainerStarted","Data":"65ade592a7f80593aebdec8ccc1e3e972d6d83ea4d1c8bd51dcfadaa9d0328f9"} Jul 16 22:22:35.143596 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.143562 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw"] Jul 16 22:22:35.146906 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.146890 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.150632 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.150609 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 16 22:22:35.150754 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.150613 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 16 22:22:35.150801 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.150759 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hnsck\"" Jul 16 22:22:35.151032 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.151018 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 16 22:22:35.160489 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.160465 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw"] Jul 16 22:22:35.162465 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.162442 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/05c5096a-e3cc-4e36-88e0-2b687c770280-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.162583 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.162473 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/05c5096a-e3cc-4e36-88e0-2b687c770280-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.162583 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.162498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05c5096a-e3cc-4e36-88e0-2b687c770280-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.162583 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.162533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/05c5096a-e3cc-4e36-88e0-2b687c770280-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.162789 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.162663 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h652n\" (UniqueName: \"kubernetes.io/projected/05c5096a-e3cc-4e36-88e0-2b687c770280-kube-api-access-h652n\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.162789 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.162704 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/05c5096a-e3cc-4e36-88e0-2b687c770280-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.162789 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.162759 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/05c5096a-e3cc-4e36-88e0-2b687c770280-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.263294 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.263257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h652n\" (UniqueName: \"kubernetes.io/projected/05c5096a-e3cc-4e36-88e0-2b687c770280-kube-api-access-h652n\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.263458 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.263310 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/05c5096a-e3cc-4e36-88e0-2b687c770280-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.263458 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.263344 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/05c5096a-e3cc-4e36-88e0-2b687c770280-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.263458 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.263421 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/05c5096a-e3cc-4e36-88e0-2b687c770280-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.263458 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.263453 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/05c5096a-e3cc-4e36-88e0-2b687c770280-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.263708 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.263478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05c5096a-e3cc-4e36-88e0-2b687c770280-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.263708 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.263525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/05c5096a-e3cc-4e36-88e0-2b687c770280-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.264391 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.264343 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/05c5096a-e3cc-4e36-88e0-2b687c770280-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.266766 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.266741 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/05c5096a-e3cc-4e36-88e0-2b687c770280-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.266866 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.266842 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/05c5096a-e3cc-4e36-88e0-2b687c770280-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.266866 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.266849 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/05c5096a-e3cc-4e36-88e0-2b687c770280-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.267199 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.267176 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/05c5096a-e3cc-4e36-88e0-2b687c770280-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.277338 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.277314 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h652n\" (UniqueName: \"kubernetes.io/projected/05c5096a-e3cc-4e36-88e0-2b687c770280-kube-api-access-h652n\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.278216 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.278146 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05c5096a-e3cc-4e36-88e0-2b687c770280-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6v4nw\" (UID: \"05c5096a-e3cc-4e36-88e0-2b687c770280\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.457279 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.457084 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:35.758769 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:35.758729 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw"] Jul 16 22:22:35.761184 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:22:35.761138 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05c5096a_e3cc_4e36_88e0_2b687c770280.slice/crio-442f4b9d045b84e608ebcde4d9d95346cb2affaba7a6adf9165d64fe172f2547 WatchSource:0}: Error finding container 442f4b9d045b84e608ebcde4d9d95346cb2affaba7a6adf9165d64fe172f2547: Status 404 returned error can't find the container with id 442f4b9d045b84e608ebcde4d9d95346cb2affaba7a6adf9165d64fe172f2547 Jul 16 22:22:36.528968 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:36.528923 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" event={"ID":"05c5096a-e3cc-4e36-88e0-2b687c770280","Type":"ContainerStarted","Data":"442f4b9d045b84e608ebcde4d9d95346cb2affaba7a6adf9165d64fe172f2547"} Jul 16 22:22:37.211797 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:37.211746 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:22:37.211937 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:37.211838 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:22:37.211937 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:37.211886 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:22:37.537375 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:37.537285 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" event={"ID":"257a6c02-856b-42bc-a76d-94e92163d7de","Type":"ContainerStarted","Data":"5104c3d2bfe6c4b13581a177dcfce36e141ea70ca594713e8341e2a76b8958ec"} Jul 16 22:22:37.586723 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:37.586662 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" podStartSLOduration=1.8000931169999999 podStartE2EDuration="4.586641744s" totalImagesPullingTime="2.786548627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:22:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:22:37.582771773 +0000 UTC m=+523.685417000" watchObservedRunningTime="2026-07-16 22:22:37.586641744 +0000 UTC m=+523.689286971" Jul 16 22:22:38.260497 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:38.260462 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:38.265609 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:38.265581 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:38.543420 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:38.543340 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:38.544593 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:38.544568 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lc7x2" Jul 16 22:22:38.949478 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:38.949445 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:22:38.949575 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:38.949508 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:22:39.549918 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:39.549885 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" event={"ID":"05c5096a-e3cc-4e36-88e0-2b687c770280","Type":"ContainerStarted","Data":"2ed8b9c7925acfbfd618c604d1dcdb603e9c984ea458b357fe889a11a58acf03"} Jul 16 22:22:39.550515 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:39.550189 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:22:39.592355 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:39.592308 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" podStartSLOduration=1.406817638 podStartE2EDuration="4.592295011s" totalImagesPullingTime="3.185477373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:22:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:22:39.591205697 +0000 UTC m=+525.693850948" watchObservedRunningTime="2026-07-16 22:22:39.592295011 +0000 UTC m=+525.694940237" Jul 16 22:22:40.556906 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:22:40.556878 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6v4nw" Jul 16 22:23:58.647173 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:23:58.647143 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:23:58.653249 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:23:58.653225 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:24:28.296414 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:28.296380 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c78689d94-49m6j"] Jul 16 22:24:44.270084 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.270037 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz"] Jul 16 22:24:44.273523 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.273503 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.276701 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.276677 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-48bfk\"" Jul 16 22:24:44.293443 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.293414 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz"] Jul 16 22:24:44.357752 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.357716 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb7d2d63-524e-421f-882b-7edd40fcf0ef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.357932 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.357792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb7d2d63-524e-421f-882b-7edd40fcf0ef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.357932 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.357821 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4vgl\" (UniqueName: \"kubernetes.io/projected/cb7d2d63-524e-421f-882b-7edd40fcf0ef-kube-api-access-c4vgl\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.357932 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.357854 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb7d2d63-524e-421f-882b-7edd40fcf0ef-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.357932 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.357876 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb7d2d63-524e-421f-882b-7edd40fcf0ef-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.358173 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.358027 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb7d2d63-524e-421f-882b-7edd40fcf0ef-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.358173 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.358119 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb7d2d63-524e-421f-882b-7edd40fcf0ef-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.358173 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.358157 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb7d2d63-524e-421f-882b-7edd40fcf0ef-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.358322 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.358186 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb7d2d63-524e-421f-882b-7edd40fcf0ef-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.458668 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.458633 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb7d2d63-524e-421f-882b-7edd40fcf0ef-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.458857 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.458685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb7d2d63-524e-421f-882b-7edd40fcf0ef-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.458857 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.458705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb7d2d63-524e-421f-882b-7edd40fcf0ef-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.458857 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.458726 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb7d2d63-524e-421f-882b-7edd40fcf0ef-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.458857 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.458753 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb7d2d63-524e-421f-882b-7edd40fcf0ef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.458857 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.458806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb7d2d63-524e-421f-882b-7edd40fcf0ef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.458857 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.458833 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4vgl\" (UniqueName: \"kubernetes.io/projected/cb7d2d63-524e-421f-882b-7edd40fcf0ef-kube-api-access-c4vgl\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.459263 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.458869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb7d2d63-524e-421f-882b-7edd40fcf0ef-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.459263 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.458894 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb7d2d63-524e-421f-882b-7edd40fcf0ef-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.459263 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.459059 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb7d2d63-524e-421f-882b-7edd40fcf0ef-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.459263 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.459122 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb7d2d63-524e-421f-882b-7edd40fcf0ef-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.459468 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.459375 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb7d2d63-524e-421f-882b-7edd40fcf0ef-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.459586 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.459561 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb7d2d63-524e-421f-882b-7edd40fcf0ef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.459715 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.459679 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb7d2d63-524e-421f-882b-7edd40fcf0ef-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.461718 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.461668 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb7d2d63-524e-421f-882b-7edd40fcf0ef-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.462232 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.462210 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb7d2d63-524e-421f-882b-7edd40fcf0ef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.476587 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.476558 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb7d2d63-524e-421f-882b-7edd40fcf0ef-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.476719 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.476701 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4vgl\" (UniqueName: \"kubernetes.io/projected/cb7d2d63-524e-421f-882b-7edd40fcf0ef-kube-api-access-c4vgl\") pod \"maas-default-gateway-openshift-default-56654dcf7-dzsmz\" (UID: \"cb7d2d63-524e-421f-882b-7edd40fcf0ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.583704 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.583619 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:44.726004 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.725976 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz"] Jul 16 22:24:44.727624 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:24:44.727601 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb7d2d63_524e_421f_882b_7edd40fcf0ef.slice/crio-7d97e19c1c5462b3f4c3ff466f13348f1eba5f5a9b6d9dae7517591b8c36c9db WatchSource:0}: Error finding container 7d97e19c1c5462b3f4c3ff466f13348f1eba5f5a9b6d9dae7517591b8c36c9db: Status 404 returned error can't find the container with id 7d97e19c1c5462b3f4c3ff466f13348f1eba5f5a9b6d9dae7517591b8c36c9db Jul 16 22:24:44.729546 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.729511 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:24:44.729634 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.729577 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:24:44.729634 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:44.729605 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:24:45.151884 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:45.151839 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" event={"ID":"cb7d2d63-524e-421f-882b-7edd40fcf0ef","Type":"ContainerStarted","Data":"97f457a7b1a1a20134c2b6e23412f93feb82d4f2be8316b4dc2a838fe7289494"} Jul 16 22:24:45.152113 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:45.151905 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" event={"ID":"cb7d2d63-524e-421f-882b-7edd40fcf0ef","Type":"ContainerStarted","Data":"7d97e19c1c5462b3f4c3ff466f13348f1eba5f5a9b6d9dae7517591b8c36c9db"} Jul 16 22:24:45.176303 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:45.176256 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" podStartSLOduration=1.17624135 podStartE2EDuration="1.17624135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:24:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:24:45.174227866 +0000 UTC m=+651.276873112" watchObservedRunningTime="2026-07-16 22:24:45.17624135 +0000 UTC m=+651.278886575" Jul 16 22:24:45.584715 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:45.584676 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:45.589840 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:45.589811 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:46.157031 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:46.156997 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:46.158139 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:46.158116 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:24:53.317193 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.317150 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c78689d94-49m6j" podUID="349b6068-95cd-4824-8ce3-59db83503415" containerName="console" containerID="cri-o://44d806651cd7664749f6be053b61c1817209737932ba70971e5fafe8f5b4c7cc" gracePeriod=15 Jul 16 22:24:53.566065 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.566040 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:24:53.652097 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.651995 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-console-config\") pod \"349b6068-95cd-4824-8ce3-59db83503415\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " Jul 16 22:24:53.652247 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.652103 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/349b6068-95cd-4824-8ce3-59db83503415-console-oauth-config\") pod \"349b6068-95cd-4824-8ce3-59db83503415\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " Jul 16 22:24:53.652247 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.652143 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/349b6068-95cd-4824-8ce3-59db83503415-console-serving-cert\") pod \"349b6068-95cd-4824-8ce3-59db83503415\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " Jul 16 22:24:53.652247 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.652175 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-trusted-ca-bundle\") pod \"349b6068-95cd-4824-8ce3-59db83503415\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " Jul 16 22:24:53.652247 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.652218 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-service-ca\") pod \"349b6068-95cd-4824-8ce3-59db83503415\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " Jul 16 22:24:53.652453 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.652251 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-oauth-serving-cert\") pod \"349b6068-95cd-4824-8ce3-59db83503415\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " Jul 16 22:24:53.652453 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.652300 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggxnk\" (UniqueName: \"kubernetes.io/projected/349b6068-95cd-4824-8ce3-59db83503415-kube-api-access-ggxnk\") pod \"349b6068-95cd-4824-8ce3-59db83503415\" (UID: \"349b6068-95cd-4824-8ce3-59db83503415\") " Jul 16 22:24:53.652587 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.652562 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-console-config" (OuterVolumeSpecName: "console-config") pod "349b6068-95cd-4824-8ce3-59db83503415" (UID: "349b6068-95cd-4824-8ce3-59db83503415"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:24:53.652718 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.652683 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-service-ca" (OuterVolumeSpecName: "service-ca") pod "349b6068-95cd-4824-8ce3-59db83503415" (UID: "349b6068-95cd-4824-8ce3-59db83503415"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:24:53.652718 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.652692 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "349b6068-95cd-4824-8ce3-59db83503415" (UID: "349b6068-95cd-4824-8ce3-59db83503415"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:24:53.652809 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.652714 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "349b6068-95cd-4824-8ce3-59db83503415" (UID: "349b6068-95cd-4824-8ce3-59db83503415"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:24:53.654337 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.654316 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/349b6068-95cd-4824-8ce3-59db83503415-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "349b6068-95cd-4824-8ce3-59db83503415" (UID: "349b6068-95cd-4824-8ce3-59db83503415"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 22:24:53.654443 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.654335 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/349b6068-95cd-4824-8ce3-59db83503415-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "349b6068-95cd-4824-8ce3-59db83503415" (UID: "349b6068-95cd-4824-8ce3-59db83503415"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 22:24:53.654443 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.654373 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/349b6068-95cd-4824-8ce3-59db83503415-kube-api-access-ggxnk" (OuterVolumeSpecName: "kube-api-access-ggxnk") pod "349b6068-95cd-4824-8ce3-59db83503415" (UID: "349b6068-95cd-4824-8ce3-59db83503415"). InnerVolumeSpecName "kube-api-access-ggxnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:24:53.753521 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.753486 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/349b6068-95cd-4824-8ce3-59db83503415-console-oauth-config\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:24:53.753521 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.753514 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/349b6068-95cd-4824-8ce3-59db83503415-console-serving-cert\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:24:53.753521 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.753524 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-trusted-ca-bundle\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:24:53.753745 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.753533 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-service-ca\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:24:53.753745 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.753542 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-oauth-serving-cert\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:24:53.753745 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.753553 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggxnk\" (UniqueName: \"kubernetes.io/projected/349b6068-95cd-4824-8ce3-59db83503415-kube-api-access-ggxnk\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:24:53.753745 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:53.753562 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/349b6068-95cd-4824-8ce3-59db83503415-console-config\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:24:54.196284 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:54.196248 2578 generic.go:356] "Generic (PLEG): container finished" podID="349b6068-95cd-4824-8ce3-59db83503415" containerID="44d806651cd7664749f6be053b61c1817209737932ba70971e5fafe8f5b4c7cc" exitCode=0 Jul 16 22:24:54.196452 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:54.196294 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c78689d94-49m6j" Jul 16 22:24:54.196452 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:54.196331 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c78689d94-49m6j" event={"ID":"349b6068-95cd-4824-8ce3-59db83503415","Type":"ContainerDied","Data":"44d806651cd7664749f6be053b61c1817209737932ba70971e5fafe8f5b4c7cc"} Jul 16 22:24:54.196452 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:54.196386 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c78689d94-49m6j" event={"ID":"349b6068-95cd-4824-8ce3-59db83503415","Type":"ContainerDied","Data":"ab0d6579aeb827ef72499d6564684318795c6a3f34177cef284a2dee4dbbdb0c"} Jul 16 22:24:54.196452 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:54.196408 2578 scope.go:117] "RemoveContainer" containerID="44d806651cd7664749f6be053b61c1817209737932ba70971e5fafe8f5b4c7cc" Jul 16 22:24:54.205642 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:54.205621 2578 scope.go:117] "RemoveContainer" containerID="44d806651cd7664749f6be053b61c1817209737932ba70971e5fafe8f5b4c7cc" Jul 16 22:24:54.205892 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:24:54.205875 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44d806651cd7664749f6be053b61c1817209737932ba70971e5fafe8f5b4c7cc\": container with ID starting with 44d806651cd7664749f6be053b61c1817209737932ba70971e5fafe8f5b4c7cc not found: ID does not exist" containerID="44d806651cd7664749f6be053b61c1817209737932ba70971e5fafe8f5b4c7cc" Jul 16 22:24:54.205953 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:54.205899 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44d806651cd7664749f6be053b61c1817209737932ba70971e5fafe8f5b4c7cc"} err="failed to get container status \"44d806651cd7664749f6be053b61c1817209737932ba70971e5fafe8f5b4c7cc\": rpc error: code = NotFound desc = could not find container \"44d806651cd7664749f6be053b61c1817209737932ba70971e5fafe8f5b4c7cc\": container with ID starting with 44d806651cd7664749f6be053b61c1817209737932ba70971e5fafe8f5b4c7cc not found: ID does not exist" Jul 16 22:24:54.223797 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:54.223763 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c78689d94-49m6j"] Jul 16 22:24:54.231488 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:54.231462 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c78689d94-49m6j"] Jul 16 22:24:54.430733 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:24:54.430699 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="349b6068-95cd-4824-8ce3-59db83503415" path="/var/lib/kubelet/pods/349b6068-95cd-4824-8ce3-59db83503415/volumes" Jul 16 22:26:13.585515 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:26:13.585479 2578 generic.go:356] "Generic (PLEG): container finished" podID="cb7d2d63-524e-421f-882b-7edd40fcf0ef" containerID="97f457a7b1a1a20134c2b6e23412f93feb82d4f2be8316b4dc2a838fe7289494" exitCode=0 Jul 16 22:26:13.585951 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:26:13.585537 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" event={"ID":"cb7d2d63-524e-421f-882b-7edd40fcf0ef","Type":"ContainerDied","Data":"97f457a7b1a1a20134c2b6e23412f93feb82d4f2be8316b4dc2a838fe7289494"} Jul 16 22:26:13.585951 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:26:13.585910 2578 scope.go:117] "RemoveContainer" containerID="97f457a7b1a1a20134c2b6e23412f93feb82d4f2be8316b4dc2a838fe7289494" Jul 16 22:26:13.586933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:26:13.586898 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:26:13.587043 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:26:13.586976 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:26:13.587043 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:26:13.587016 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:26:14.594143 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:26:14.594098 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" event={"ID":"cb7d2d63-524e-421f-882b-7edd40fcf0ef","Type":"ContainerStarted","Data":"14a533cd6da9ff6a05ffa33b9a2d048ee320a858df70bd877d10e03775c287a8"} Jul 16 22:26:15.584543 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:26:15.584500 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:26:15.585601 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:26:15.585571 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dzsmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 16 22:26:15.585749 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:26:15.585623 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" podUID="cb7d2d63-524e-421f-882b-7edd40fcf0ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 16 22:26:16.157895 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:26:16.157861 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:26:16.584215 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:26:16.584177 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dzsmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 16 22:26:16.584440 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:26:16.584257 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" podUID="cb7d2d63-524e-421f-882b-7edd40fcf0ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 16 22:26:17.585000 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:26:17.584960 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dzsmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 16 22:26:17.585472 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:26:17.585127 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" podUID="cb7d2d63-524e-421f-882b-7edd40fcf0ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 16 22:26:18.584197 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:26:18.584159 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dzsmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 16 22:26:18.584374 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:26:18.584218 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" podUID="cb7d2d63-524e-421f-882b-7edd40fcf0ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 16 22:26:19.588769 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:26:19.588740 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:26:19.589732 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:26:19.589712 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dzsmz" Jul 16 22:27:01.239642 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.239607 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6"] Jul 16 22:27:01.240166 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.239992 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="349b6068-95cd-4824-8ce3-59db83503415" containerName="console" Jul 16 22:27:01.240166 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.240006 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="349b6068-95cd-4824-8ce3-59db83503415" containerName="console" Jul 16 22:27:01.240166 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.240099 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="349b6068-95cd-4824-8ce3-59db83503415" containerName="console" Jul 16 22:27:01.242390 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.242372 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.246627 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.246601 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 16 22:27:01.246767 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.246663 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2bhmx\"" Jul 16 22:27:01.246767 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.246703 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 16 22:27:01.246767 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.246722 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 16 22:27:01.254511 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.254479 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6"] Jul 16 22:27:01.266908 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.266883 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f31a54dd-19d7-49f9-b471-11b168f13dd6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2mv6\" (UID: \"f31a54dd-19d7-49f9-b471-11b168f13dd6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.267039 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.266925 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f31a54dd-19d7-49f9-b471-11b168f13dd6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2mv6\" (UID: \"f31a54dd-19d7-49f9-b471-11b168f13dd6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.267039 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.266983 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f31a54dd-19d7-49f9-b471-11b168f13dd6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2mv6\" (UID: \"f31a54dd-19d7-49f9-b471-11b168f13dd6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.267135 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.267043 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m2tw\" (UniqueName: \"kubernetes.io/projected/f31a54dd-19d7-49f9-b471-11b168f13dd6-kube-api-access-5m2tw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2mv6\" (UID: \"f31a54dd-19d7-49f9-b471-11b168f13dd6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.267135 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.267121 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f31a54dd-19d7-49f9-b471-11b168f13dd6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2mv6\" (UID: \"f31a54dd-19d7-49f9-b471-11b168f13dd6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.267218 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.267163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f31a54dd-19d7-49f9-b471-11b168f13dd6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2mv6\" (UID: \"f31a54dd-19d7-49f9-b471-11b168f13dd6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.368207 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.368170 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f31a54dd-19d7-49f9-b471-11b168f13dd6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2mv6\" (UID: \"f31a54dd-19d7-49f9-b471-11b168f13dd6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.368207 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.368217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f31a54dd-19d7-49f9-b471-11b168f13dd6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2mv6\" (UID: \"f31a54dd-19d7-49f9-b471-11b168f13dd6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.368471 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.368339 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f31a54dd-19d7-49f9-b471-11b168f13dd6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2mv6\" (UID: \"f31a54dd-19d7-49f9-b471-11b168f13dd6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.368471 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.368406 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m2tw\" (UniqueName: \"kubernetes.io/projected/f31a54dd-19d7-49f9-b471-11b168f13dd6-kube-api-access-5m2tw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2mv6\" (UID: \"f31a54dd-19d7-49f9-b471-11b168f13dd6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.368471 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.368461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f31a54dd-19d7-49f9-b471-11b168f13dd6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2mv6\" (UID: \"f31a54dd-19d7-49f9-b471-11b168f13dd6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.368614 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.368491 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f31a54dd-19d7-49f9-b471-11b168f13dd6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2mv6\" (UID: \"f31a54dd-19d7-49f9-b471-11b168f13dd6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.368692 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.368671 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f31a54dd-19d7-49f9-b471-11b168f13dd6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2mv6\" (UID: \"f31a54dd-19d7-49f9-b471-11b168f13dd6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.368915 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.368892 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f31a54dd-19d7-49f9-b471-11b168f13dd6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2mv6\" (UID: \"f31a54dd-19d7-49f9-b471-11b168f13dd6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.369012 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.368944 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f31a54dd-19d7-49f9-b471-11b168f13dd6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2mv6\" (UID: \"f31a54dd-19d7-49f9-b471-11b168f13dd6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.371107 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.371084 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f31a54dd-19d7-49f9-b471-11b168f13dd6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2mv6\" (UID: \"f31a54dd-19d7-49f9-b471-11b168f13dd6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.371362 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.371343 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f31a54dd-19d7-49f9-b471-11b168f13dd6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2mv6\" (UID: \"f31a54dd-19d7-49f9-b471-11b168f13dd6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.377702 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.377681 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m2tw\" (UniqueName: \"kubernetes.io/projected/f31a54dd-19d7-49f9-b471-11b168f13dd6-kube-api-access-5m2tw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2mv6\" (UID: \"f31a54dd-19d7-49f9-b471-11b168f13dd6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.553714 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.553618 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:01.689263 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.687796 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6"] Jul 16 22:27:01.691727 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:27:01.691700 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf31a54dd_19d7_49f9_b471_11b168f13dd6.slice/crio-35b85bc5c55f3b3593c8472ea85e1cfcc31f9573be7e36c64910c2d40ab4feb0 WatchSource:0}: Error finding container 35b85bc5c55f3b3593c8472ea85e1cfcc31f9573be7e36c64910c2d40ab4feb0: Status 404 returned error can't find the container with id 35b85bc5c55f3b3593c8472ea85e1cfcc31f9573be7e36c64910c2d40ab4feb0 Jul 16 22:27:01.693080 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.693046 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 22:27:01.824040 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:01.823953 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" event={"ID":"f31a54dd-19d7-49f9-b471-11b168f13dd6","Type":"ContainerStarted","Data":"35b85bc5c55f3b3593c8472ea85e1cfcc31f9573be7e36c64910c2d40ab4feb0"} Jul 16 22:27:02.837921 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:02.837875 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" event={"ID":"f31a54dd-19d7-49f9-b471-11b168f13dd6","Type":"ContainerStarted","Data":"2ed17ac56e959e77f4fd91a85c48ac4a3923c0fbe1c1846b30791896c7447380"} Jul 16 22:27:02.858472 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:02.858414 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" podStartSLOduration=0.818286037 podStartE2EDuration="1.858396807s" totalImagesPullingTime="1.04011077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:27:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:27:02.857591728 +0000 UTC m=+788.960236977" watchObservedRunningTime="2026-07-16 22:27:02.858396807 +0000 UTC m=+788.961042033" Jul 16 22:27:11.553854 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:11.553811 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:11.554393 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:11.553871 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:11.566431 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:11.566406 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:11.893984 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:11.893902 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2mv6" Jul 16 22:27:26.721034 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.721001 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79"] Jul 16 22:27:26.724663 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.724641 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:26.727526 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.727504 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 16 22:27:26.740335 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.740308 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79"] Jul 16 22:27:26.811034 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.811001 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/031a8afb-edf3-41b2-9267-434532fafb79-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2hp79\" (UID: \"031a8afb-edf3-41b2-9267-434532fafb79\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:26.811034 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.811036 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/031a8afb-edf3-41b2-9267-434532fafb79-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2hp79\" (UID: \"031a8afb-edf3-41b2-9267-434532fafb79\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:26.811260 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.811086 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn6mh\" (UniqueName: \"kubernetes.io/projected/031a8afb-edf3-41b2-9267-434532fafb79-kube-api-access-nn6mh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2hp79\" (UID: \"031a8afb-edf3-41b2-9267-434532fafb79\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:26.811260 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.811141 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/031a8afb-edf3-41b2-9267-434532fafb79-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2hp79\" (UID: \"031a8afb-edf3-41b2-9267-434532fafb79\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:26.811260 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.811167 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/031a8afb-edf3-41b2-9267-434532fafb79-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2hp79\" (UID: \"031a8afb-edf3-41b2-9267-434532fafb79\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:26.811260 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.811208 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/031a8afb-edf3-41b2-9267-434532fafb79-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2hp79\" (UID: \"031a8afb-edf3-41b2-9267-434532fafb79\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:26.912642 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.912605 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn6mh\" (UniqueName: \"kubernetes.io/projected/031a8afb-edf3-41b2-9267-434532fafb79-kube-api-access-nn6mh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2hp79\" (UID: \"031a8afb-edf3-41b2-9267-434532fafb79\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:26.912820 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.912655 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/031a8afb-edf3-41b2-9267-434532fafb79-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2hp79\" (UID: \"031a8afb-edf3-41b2-9267-434532fafb79\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:26.912820 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.912685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/031a8afb-edf3-41b2-9267-434532fafb79-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2hp79\" (UID: \"031a8afb-edf3-41b2-9267-434532fafb79\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:26.912820 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.912743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/031a8afb-edf3-41b2-9267-434532fafb79-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2hp79\" (UID: \"031a8afb-edf3-41b2-9267-434532fafb79\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:26.912964 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.912827 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/031a8afb-edf3-41b2-9267-434532fafb79-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2hp79\" (UID: \"031a8afb-edf3-41b2-9267-434532fafb79\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:26.912964 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.912853 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/031a8afb-edf3-41b2-9267-434532fafb79-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2hp79\" (UID: \"031a8afb-edf3-41b2-9267-434532fafb79\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:26.913213 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.913190 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/031a8afb-edf3-41b2-9267-434532fafb79-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2hp79\" (UID: \"031a8afb-edf3-41b2-9267-434532fafb79\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:26.913300 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.913243 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/031a8afb-edf3-41b2-9267-434532fafb79-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2hp79\" (UID: \"031a8afb-edf3-41b2-9267-434532fafb79\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:26.913300 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.913276 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/031a8afb-edf3-41b2-9267-434532fafb79-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2hp79\" (UID: \"031a8afb-edf3-41b2-9267-434532fafb79\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:26.915048 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.915026 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/031a8afb-edf3-41b2-9267-434532fafb79-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2hp79\" (UID: \"031a8afb-edf3-41b2-9267-434532fafb79\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:26.915309 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.915293 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/031a8afb-edf3-41b2-9267-434532fafb79-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2hp79\" (UID: \"031a8afb-edf3-41b2-9267-434532fafb79\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:26.921295 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:26.921277 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn6mh\" (UniqueName: \"kubernetes.io/projected/031a8afb-edf3-41b2-9267-434532fafb79-kube-api-access-nn6mh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2hp79\" (UID: \"031a8afb-edf3-41b2-9267-434532fafb79\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:27.036892 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:27.036812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:27.167280 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:27.167254 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79"] Jul 16 22:27:27.169428 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:27:27.169401 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod031a8afb_edf3_41b2_9267_434532fafb79.slice/crio-251116d7f751da818473c3680be88d5efac3b8cb9e53fc01e05b233b34790460 WatchSource:0}: Error finding container 251116d7f751da818473c3680be88d5efac3b8cb9e53fc01e05b233b34790460: Status 404 returned error can't find the container with id 251116d7f751da818473c3680be88d5efac3b8cb9e53fc01e05b233b34790460 Jul 16 22:27:27.964975 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:27.964943 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" event={"ID":"031a8afb-edf3-41b2-9267-434532fafb79","Type":"ContainerStarted","Data":"6946405dc82439ab287a5c3bc9dd576ecc3002c6069997c82c2a46066773c0e5"} Jul 16 22:27:27.965383 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:27.965002 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" event={"ID":"031a8afb-edf3-41b2-9267-434532fafb79","Type":"ContainerStarted","Data":"251116d7f751da818473c3680be88d5efac3b8cb9e53fc01e05b233b34790460"} Jul 16 22:27:27.985435 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:27.985384 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" podStartSLOduration=1.789147636 podStartE2EDuration="1.985367852s" totalImagesPullingTime="196.220216ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:27:27.982829091 +0000 UTC m=+814.085474340" watchObservedRunningTime="2026-07-16 22:27:27.985367852 +0000 UTC m=+814.088013078" Jul 16 22:27:37.037472 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:37.037436 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:37.037958 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:37.037492 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:37.049847 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:37.049816 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:27:38.026111 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:27:38.026061 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2hp79" Jul 16 22:28:58.683917 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:28:58.683810 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:28:58.689418 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:28:58.689390 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:33:58.725018 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:33:58.724985 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:33:58.731496 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:33:58.731469 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:38:58.756612 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:38:58.756584 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:38:58.763818 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:38:58.763793 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:42:54.296936 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.296897 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz"] Jul 16 22:42:54.301378 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.301359 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.305133 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.305113 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f24d3bde-openshift-default-dockercfg-kxn6m\"" Jul 16 22:42:54.337635 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.337591 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz"] Jul 16 22:42:54.365268 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.365239 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-envoy\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.365405 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.365274 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-credential-socket\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.365405 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.365372 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-podinfo\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.365504 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.365409 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-workload-certs\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.365504 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.365432 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-workload-socket\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.365504 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.365491 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-token\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.365600 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.365511 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-data\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.365600 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.365586 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istiod-ca-cert\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.365664 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.365613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx29r\" (UniqueName: \"kubernetes.io/projected/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-kube-api-access-jx29r\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.466930 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.466894 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istiod-ca-cert\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.466930 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.466930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx29r\" (UniqueName: \"kubernetes.io/projected/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-kube-api-access-jx29r\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.467205 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.466955 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-envoy\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.467205 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.466971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-credential-socket\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.467205 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.467012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-podinfo\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.467205 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.467031 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-workload-certs\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.467205 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.467053 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-workload-socket\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.467205 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.467124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-token\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.467205 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.467158 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-data\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.467625 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.467469 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-credential-socket\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.467625 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.467517 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-workload-certs\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.467625 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.467570 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-workload-socket\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.467625 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.467588 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-data\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.467827 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.467802 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istiod-ca-cert\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.469184 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.469147 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-envoy\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.469398 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.469382 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-podinfo\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.478759 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.478740 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx29r\" (UniqueName: \"kubernetes.io/projected/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-kube-api-access-jx29r\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.479506 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.479489 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-token\") pod \"e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.613264 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.613195 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:54.781570 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.781545 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz"] Jul 16 22:42:54.783101 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:42:54.783038 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8b668f2_f16f_443c_a7cc_1d7bd2f690e6.slice/crio-e18159075c2f69538967775ce0d2a1fa1b1289da77a26cadc612974bc3c9a359 WatchSource:0}: Error finding container e18159075c2f69538967775ce0d2a1fa1b1289da77a26cadc612974bc3c9a359: Status 404 returned error can't find the container with id e18159075c2f69538967775ce0d2a1fa1b1289da77a26cadc612974bc3c9a359 Jul 16 22:42:54.784917 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.784887 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:42:54.784981 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.784948 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:42:54.784981 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:54.784974 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:42:55.599796 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:55.599761 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" event={"ID":"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6","Type":"ContainerStarted","Data":"c488bfc8081c8b8af64a3465ea2010eedafa9675aad7bf1b6c4e89c877680c85"} Jul 16 22:42:55.600197 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:55.599842 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" event={"ID":"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6","Type":"ContainerStarted","Data":"e18159075c2f69538967775ce0d2a1fa1b1289da77a26cadc612974bc3c9a359"} Jul 16 22:42:55.613841 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:55.613808 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:55.618501 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:55.618481 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:55.636648 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:55.636604 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" podStartSLOduration=1.636590795 podStartE2EDuration="1.636590795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:42:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:42:55.634122073 +0000 UTC m=+1741.736767310" watchObservedRunningTime="2026-07-16 22:42:55.636590795 +0000 UTC m=+1741.739236020" Jul 16 22:42:56.604567 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:56.604534 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:42:56.605570 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:42:56.605545 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:43:07.688241 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:07.688154 2578 generic.go:356] "Generic (PLEG): container finished" podID="b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" containerID="c488bfc8081c8b8af64a3465ea2010eedafa9675aad7bf1b6c4e89c877680c85" exitCode=0 Jul 16 22:43:07.688241 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:07.688229 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" event={"ID":"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6","Type":"ContainerDied","Data":"c488bfc8081c8b8af64a3465ea2010eedafa9675aad7bf1b6c4e89c877680c85"} Jul 16 22:43:07.688665 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:07.688655 2578 scope.go:117] "RemoveContainer" containerID="c488bfc8081c8b8af64a3465ea2010eedafa9675aad7bf1b6c4e89c877680c85" Jul 16 22:43:07.689652 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:07.689623 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:43:07.689759 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:07.689688 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:43:07.689759 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:07.689720 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:43:08.695099 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:08.695047 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" event={"ID":"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6","Type":"ContainerStarted","Data":"c3c09bb7df1ba1015c662c8d54f8a5f2d553043a87f6dc6af89f67faa9dbcd11"} Jul 16 22:43:09.613737 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:09.613706 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:43:09.614928 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:09.614900 2578 patch_prober.go:28] interesting pod/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 16 22:43:09.615041 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:09.614950 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" podUID="b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 16 22:43:10.614136 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:10.614094 2578 patch_prober.go:28] interesting pod/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 16 22:43:10.614631 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:10.614155 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" podUID="b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 16 22:43:11.605243 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:11.605210 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:43:11.613900 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:11.613876 2578 patch_prober.go:28] interesting pod/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 16 22:43:11.613967 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:11.613927 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" podUID="b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 16 22:43:12.614456 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:12.614417 2578 patch_prober.go:28] interesting pod/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 16 22:43:12.614859 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:12.614474 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" podUID="b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 16 22:43:13.617980 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:13.617951 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:43:13.619101 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:13.619061 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:43:58.788623 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:58.788589 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:43:58.796985 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:43:58.796963 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:44:05.900611 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:05.900573 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz"] Jul 16 22:44:05.900994 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:05.900810 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" podUID="b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" containerName="istio-proxy" containerID="cri-o://c3c09bb7df1ba1015c662c8d54f8a5f2d553043a87f6dc6af89f67faa9dbcd11" gracePeriod=30 Jul 16 22:44:11.150428 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.150403 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:44:11.222788 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.222755 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-workload-socket\") pod \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " Jul 16 22:44:11.222911 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.222796 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istiod-ca-cert\") pod \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " Jul 16 22:44:11.222952 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.222907 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-envoy\") pod \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " Jul 16 22:44:11.222952 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.222944 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-data\") pod \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " Jul 16 22:44:11.223056 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.222973 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-token\") pod \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " Jul 16 22:44:11.223056 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.223040 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-workload-certs\") pod \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " Jul 16 22:44:11.223176 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.223062 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" (UID: "b8b668f2-f16f-443c-a7cc-1d7bd2f690e6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:44:11.223176 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.223117 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jx29r\" (UniqueName: \"kubernetes.io/projected/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-kube-api-access-jx29r\") pod \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " Jul 16 22:44:11.223176 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.223174 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-credential-socket\") pod \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " Jul 16 22:44:11.223326 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.223209 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-podinfo\") pod \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\" (UID: \"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6\") " Jul 16 22:44:11.223663 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.223582 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-workload-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:44:11.223906 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.223577 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" (UID: "b8b668f2-f16f-443c-a7cc-1d7bd2f690e6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:44:11.223906 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.223599 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" (UID: "b8b668f2-f16f-443c-a7cc-1d7bd2f690e6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:44:11.223906 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.223754 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" (UID: "b8b668f2-f16f-443c-a7cc-1d7bd2f690e6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:44:11.223906 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.223856 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" (UID: "b8b668f2-f16f-443c-a7cc-1d7bd2f690e6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:44:11.225897 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.225868 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" (UID: "b8b668f2-f16f-443c-a7cc-1d7bd2f690e6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 22:44:11.225897 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.225882 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-kube-api-access-jx29r" (OuterVolumeSpecName: "kube-api-access-jx29r") pod "b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" (UID: "b8b668f2-f16f-443c-a7cc-1d7bd2f690e6"). InnerVolumeSpecName "kube-api-access-jx29r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:44:11.226029 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.225926 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" (UID: "b8b668f2-f16f-443c-a7cc-1d7bd2f690e6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:44:11.226164 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.226138 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" (UID: "b8b668f2-f16f-443c-a7cc-1d7bd2f690e6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:44:11.324811 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.324776 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-credential-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:44:11.324811 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.324808 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-podinfo\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:44:11.324811 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.324818 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istiod-ca-cert\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:44:11.325033 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.324826 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-envoy\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:44:11.325033 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.324834 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-data\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:44:11.325033 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.324841 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-istio-token\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:44:11.325033 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.324848 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-workload-certs\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:44:11.325033 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:11.324856 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jx29r\" (UniqueName: \"kubernetes.io/projected/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6-kube-api-access-jx29r\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:44:12.019682 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:12.019646 2578 generic.go:356] "Generic (PLEG): container finished" podID="b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" containerID="c3c09bb7df1ba1015c662c8d54f8a5f2d553043a87f6dc6af89f67faa9dbcd11" exitCode=0 Jul 16 22:44:12.019880 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:12.019697 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" Jul 16 22:44:12.019880 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:12.019726 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" event={"ID":"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6","Type":"ContainerDied","Data":"c3c09bb7df1ba1015c662c8d54f8a5f2d553043a87f6dc6af89f67faa9dbcd11"} Jul 16 22:44:12.019880 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:12.019777 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz" event={"ID":"b8b668f2-f16f-443c-a7cc-1d7bd2f690e6","Type":"ContainerDied","Data":"e18159075c2f69538967775ce0d2a1fa1b1289da77a26cadc612974bc3c9a359"} Jul 16 22:44:12.019880 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:12.019799 2578 scope.go:117] "RemoveContainer" containerID="c3c09bb7df1ba1015c662c8d54f8a5f2d553043a87f6dc6af89f67faa9dbcd11" Jul 16 22:44:12.037034 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:12.037011 2578 scope.go:117] "RemoveContainer" containerID="c488bfc8081c8b8af64a3465ea2010eedafa9675aad7bf1b6c4e89c877680c85" Jul 16 22:44:12.045037 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:12.045019 2578 scope.go:117] "RemoveContainer" containerID="c3c09bb7df1ba1015c662c8d54f8a5f2d553043a87f6dc6af89f67faa9dbcd11" Jul 16 22:44:12.045313 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:44:12.045293 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3c09bb7df1ba1015c662c8d54f8a5f2d553043a87f6dc6af89f67faa9dbcd11\": container with ID starting with c3c09bb7df1ba1015c662c8d54f8a5f2d553043a87f6dc6af89f67faa9dbcd11 not found: ID does not exist" containerID="c3c09bb7df1ba1015c662c8d54f8a5f2d553043a87f6dc6af89f67faa9dbcd11" Jul 16 22:44:12.045362 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:12.045321 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c09bb7df1ba1015c662c8d54f8a5f2d553043a87f6dc6af89f67faa9dbcd11"} err="failed to get container status \"c3c09bb7df1ba1015c662c8d54f8a5f2d553043a87f6dc6af89f67faa9dbcd11\": rpc error: code = NotFound desc = could not find container \"c3c09bb7df1ba1015c662c8d54f8a5f2d553043a87f6dc6af89f67faa9dbcd11\": container with ID starting with c3c09bb7df1ba1015c662c8d54f8a5f2d553043a87f6dc6af89f67faa9dbcd11 not found: ID does not exist" Jul 16 22:44:12.045362 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:12.045337 2578 scope.go:117] "RemoveContainer" containerID="c488bfc8081c8b8af64a3465ea2010eedafa9675aad7bf1b6c4e89c877680c85" Jul 16 22:44:12.045560 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:44:12.045542 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c488bfc8081c8b8af64a3465ea2010eedafa9675aad7bf1b6c4e89c877680c85\": container with ID starting with c488bfc8081c8b8af64a3465ea2010eedafa9675aad7bf1b6c4e89c877680c85 not found: ID does not exist" containerID="c488bfc8081c8b8af64a3465ea2010eedafa9675aad7bf1b6c4e89c877680c85" Jul 16 22:44:12.045603 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:12.045564 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c488bfc8081c8b8af64a3465ea2010eedafa9675aad7bf1b6c4e89c877680c85"} err="failed to get container status \"c488bfc8081c8b8af64a3465ea2010eedafa9675aad7bf1b6c4e89c877680c85\": rpc error: code = NotFound desc = could not find container \"c488bfc8081c8b8af64a3465ea2010eedafa9675aad7bf1b6c4e89c877680c85\": container with ID starting with c488bfc8081c8b8af64a3465ea2010eedafa9675aad7bf1b6c4e89c877680c85 not found: ID does not exist" Jul 16 22:44:12.048747 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:12.048727 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz"] Jul 16 22:44:12.054396 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:12.054359 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f24d3bde-openshift-default-8444d58dc-kphgz"] Jul 16 22:44:12.432212 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:12.432132 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" path="/var/lib/kubelet/pods/b8b668f2-f16f-443c-a7cc-1d7bd2f690e6/volumes" Jul 16 22:44:12.990278 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:12.990239 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6"] Jul 16 22:44:12.990638 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:12.990625 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" containerName="istio-proxy" Jul 16 22:44:12.990638 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:12.990639 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" containerName="istio-proxy" Jul 16 22:44:12.990760 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:12.990705 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" containerName="istio-proxy" Jul 16 22:44:12.995294 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:12.995268 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.000217 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.000192 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-907fee31-gw-openshift-default-dockercfg-gxcvn\"" Jul 16 22:44:13.020285 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.020259 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6"] Jul 16 22:44:13.141253 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.141218 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-envoy\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.141415 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.141270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpp9n\" (UniqueName: \"kubernetes.io/projected/5ac8e77b-d6b6-464f-8068-f89125377ef4-kube-api-access-hpp9n\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.141415 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.141303 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-workload-socket\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.141415 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.141363 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-podinfo\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.141415 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.141400 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-workload-certs\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.141554 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.141425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-data\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.141554 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.141485 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ac8e77b-d6b6-464f-8068-f89125377ef4-istiod-ca-cert\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.141554 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.141517 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-credential-socket\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.141554 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.141546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-token\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.242430 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.242334 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpp9n\" (UniqueName: \"kubernetes.io/projected/5ac8e77b-d6b6-464f-8068-f89125377ef4-kube-api-access-hpp9n\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.242430 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.242400 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-workload-socket\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.242658 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.242434 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-podinfo\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.242658 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.242464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-workload-certs\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.242658 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.242488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-data\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.242658 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.242528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ac8e77b-d6b6-464f-8068-f89125377ef4-istiod-ca-cert\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.242658 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.242567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-credential-socket\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.242658 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.242611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-token\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.242957 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.242676 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-envoy\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.242957 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.242873 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-workload-socket\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.242957 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.242941 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-data\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.243111 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.242933 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-workload-certs\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.243111 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.243022 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-credential-socket\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.243292 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.243266 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ac8e77b-d6b6-464f-8068-f89125377ef4-istiod-ca-cert\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.244899 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.244876 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-envoy\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.245155 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.245135 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-podinfo\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.258504 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.258484 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-token\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.259908 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.259891 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpp9n\" (UniqueName: \"kubernetes.io/projected/5ac8e77b-d6b6-464f-8068-f89125377ef4-kube-api-access-hpp9n\") pod \"e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.307438 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.307408 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:13.452404 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.452376 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6"] Jul 16 22:44:13.453249 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:44:13.453218 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac8e77b_d6b6_464f_8068_f89125377ef4.slice/crio-d8539f8a24b552b1fdd5a177e084c6f8bf021c4809c7081f35651897b2b25600 WatchSource:0}: Error finding container d8539f8a24b552b1fdd5a177e084c6f8bf021c4809c7081f35651897b2b25600: Status 404 returned error can't find the container with id d8539f8a24b552b1fdd5a177e084c6f8bf021c4809c7081f35651897b2b25600 Jul 16 22:44:13.455529 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.455497 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:44:13.455636 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.455580 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:44:13.455636 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:13.455624 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:44:14.032472 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:14.032434 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" event={"ID":"5ac8e77b-d6b6-464f-8068-f89125377ef4","Type":"ContainerStarted","Data":"4ba03c4be6e5325e041441327a5252e65418c52df13cddb2f12807f04bd8467d"} Jul 16 22:44:14.032649 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:14.032497 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" event={"ID":"5ac8e77b-d6b6-464f-8068-f89125377ef4","Type":"ContainerStarted","Data":"d8539f8a24b552b1fdd5a177e084c6f8bf021c4809c7081f35651897b2b25600"} Jul 16 22:44:14.066458 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:14.066407 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" podStartSLOduration=2.066384414 podStartE2EDuration="2.066384414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:44:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:44:14.064204271 +0000 UTC m=+1820.166849515" watchObservedRunningTime="2026-07-16 22:44:14.066384414 +0000 UTC m=+1820.169029640" Jul 16 22:44:14.307822 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:14.307741 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:14.312694 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:14.312668 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:15.037212 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:15.037184 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:15.037950 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:15.037928 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:31.078235 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:31.078192 2578 patch_prober.go:28] interesting pod/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 16 22:44:31.079461 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:31.078281 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" podUID="5ac8e77b-d6b6-464f-8068-f89125377ef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 16 22:44:31.119763 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:31.119732 2578 generic.go:356] "Generic (PLEG): container finished" podID="5ac8e77b-d6b6-464f-8068-f89125377ef4" containerID="4ba03c4be6e5325e041441327a5252e65418c52df13cddb2f12807f04bd8467d" exitCode=0 Jul 16 22:44:31.119882 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:31.119807 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" event={"ID":"5ac8e77b-d6b6-464f-8068-f89125377ef4","Type":"ContainerDied","Data":"4ba03c4be6e5325e041441327a5252e65418c52df13cddb2f12807f04bd8467d"} Jul 16 22:44:31.120258 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:31.120242 2578 scope.go:117] "RemoveContainer" containerID="4ba03c4be6e5325e041441327a5252e65418c52df13cddb2f12807f04bd8467d" Jul 16 22:44:31.121292 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:31.121264 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:44:31.121391 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:31.121330 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:44:31.121391 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:31.121360 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:44:32.130928 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:32.130891 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" event={"ID":"5ac8e77b-d6b6-464f-8068-f89125377ef4","Type":"ContainerStarted","Data":"55dc6e014eb7c51a1b13d48522e1e1758d2783c77042219c46c79a5b77645fc5"} Jul 16 22:44:32.307713 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:32.307675 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:32.307926 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:32.307903 2578 patch_prober.go:28] interesting pod/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 16 22:44:32.307977 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:32.307953 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" podUID="5ac8e77b-d6b6-464f-8068-f89125377ef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 16 22:44:33.308276 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:33.308237 2578 patch_prober.go:28] interesting pod/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 16 22:44:33.308666 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:33.308311 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" podUID="5ac8e77b-d6b6-464f-8068-f89125377ef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 16 22:44:34.307966 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:34.307925 2578 patch_prober.go:28] interesting pod/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 16 22:44:34.308186 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:34.307983 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" podUID="5ac8e77b-d6b6-464f-8068-f89125377ef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 16 22:44:35.308313 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:35.308268 2578 patch_prober.go:28] interesting pod/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 16 22:44:35.308813 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:35.308358 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" podUID="5ac8e77b-d6b6-464f-8068-f89125377ef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 16 22:44:36.311353 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:36.311322 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:36.311823 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:36.311811 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:44:36.312576 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:44:36.312552 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:45:18.961468 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:18.961383 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6"] Jul 16 22:45:18.961935 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:18.961592 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" podUID="5ac8e77b-d6b6-464f-8068-f89125377ef4" containerName="istio-proxy" containerID="cri-o://55dc6e014eb7c51a1b13d48522e1e1758d2783c77042219c46c79a5b77645fc5" gracePeriod=30 Jul 16 22:45:21.314774 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:21.314727 2578 patch_prober.go:28] interesting pod/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 16 22:45:21.315206 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:21.314803 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" podUID="5ac8e77b-d6b6-464f-8068-f89125377ef4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 22:45:24.221429 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.221365 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:45:24.332550 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.332519 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-podinfo\") pod \"5ac8e77b-d6b6-464f-8068-f89125377ef4\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " Jul 16 22:45:24.332712 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.332581 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpp9n\" (UniqueName: \"kubernetes.io/projected/5ac8e77b-d6b6-464f-8068-f89125377ef4-kube-api-access-hpp9n\") pod \"5ac8e77b-d6b6-464f-8068-f89125377ef4\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " Jul 16 22:45:24.332712 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.332605 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-envoy\") pod \"5ac8e77b-d6b6-464f-8068-f89125377ef4\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " Jul 16 22:45:24.332826 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.332712 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-credential-socket\") pod \"5ac8e77b-d6b6-464f-8068-f89125377ef4\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " Jul 16 22:45:24.332826 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.332775 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ac8e77b-d6b6-464f-8068-f89125377ef4-istiod-ca-cert\") pod \"5ac8e77b-d6b6-464f-8068-f89125377ef4\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " Jul 16 22:45:24.332826 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.332818 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-workload-socket\") pod \"5ac8e77b-d6b6-464f-8068-f89125377ef4\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " Jul 16 22:45:24.332985 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.332849 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-token\") pod \"5ac8e77b-d6b6-464f-8068-f89125377ef4\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " Jul 16 22:45:24.332985 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.332900 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-workload-certs\") pod \"5ac8e77b-d6b6-464f-8068-f89125377ef4\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " Jul 16 22:45:24.332985 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.332932 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-data\") pod \"5ac8e77b-d6b6-464f-8068-f89125377ef4\" (UID: \"5ac8e77b-d6b6-464f-8068-f89125377ef4\") " Jul 16 22:45:24.332985 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.332931 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5ac8e77b-d6b6-464f-8068-f89125377ef4" (UID: "5ac8e77b-d6b6-464f-8068-f89125377ef4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:45:24.333240 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.333051 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5ac8e77b-d6b6-464f-8068-f89125377ef4" (UID: "5ac8e77b-d6b6-464f-8068-f89125377ef4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:45:24.333240 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.333144 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ac8e77b-d6b6-464f-8068-f89125377ef4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5ac8e77b-d6b6-464f-8068-f89125377ef4" (UID: "5ac8e77b-d6b6-464f-8068-f89125377ef4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:45:24.333347 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.333310 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5ac8e77b-d6b6-464f-8068-f89125377ef4" (UID: "5ac8e77b-d6b6-464f-8068-f89125377ef4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:45:24.333403 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.333387 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-workload-certs\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:45:24.333456 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.333410 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-credential-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:45:24.333456 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.333428 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ac8e77b-d6b6-464f-8068-f89125377ef4-istiod-ca-cert\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:45:24.333456 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.333443 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-workload-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:45:24.333831 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.333802 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-data" (OuterVolumeSpecName: "istio-data") pod "5ac8e77b-d6b6-464f-8068-f89125377ef4" (UID: "5ac8e77b-d6b6-464f-8068-f89125377ef4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:45:24.334836 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.334811 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5ac8e77b-d6b6-464f-8068-f89125377ef4" (UID: "5ac8e77b-d6b6-464f-8068-f89125377ef4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:45:24.334836 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.334818 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ac8e77b-d6b6-464f-8068-f89125377ef4-kube-api-access-hpp9n" (OuterVolumeSpecName: "kube-api-access-hpp9n") pod "5ac8e77b-d6b6-464f-8068-f89125377ef4" (UID: "5ac8e77b-d6b6-464f-8068-f89125377ef4"). InnerVolumeSpecName "kube-api-access-hpp9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:45:24.334971 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.334835 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5ac8e77b-d6b6-464f-8068-f89125377ef4" (UID: "5ac8e77b-d6b6-464f-8068-f89125377ef4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 22:45:24.335121 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.335100 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-token" (OuterVolumeSpecName: "istio-token") pod "5ac8e77b-d6b6-464f-8068-f89125377ef4" (UID: "5ac8e77b-d6b6-464f-8068-f89125377ef4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:45:24.395117 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.395065 2578 generic.go:356] "Generic (PLEG): container finished" podID="5ac8e77b-d6b6-464f-8068-f89125377ef4" containerID="55dc6e014eb7c51a1b13d48522e1e1758d2783c77042219c46c79a5b77645fc5" exitCode=0 Jul 16 22:45:24.395238 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.395141 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" Jul 16 22:45:24.395238 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.395165 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" event={"ID":"5ac8e77b-d6b6-464f-8068-f89125377ef4","Type":"ContainerDied","Data":"55dc6e014eb7c51a1b13d48522e1e1758d2783c77042219c46c79a5b77645fc5"} Jul 16 22:45:24.395238 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.395220 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6" event={"ID":"5ac8e77b-d6b6-464f-8068-f89125377ef4","Type":"ContainerDied","Data":"d8539f8a24b552b1fdd5a177e084c6f8bf021c4809c7081f35651897b2b25600"} Jul 16 22:45:24.395365 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.395242 2578 scope.go:117] "RemoveContainer" containerID="55dc6e014eb7c51a1b13d48522e1e1758d2783c77042219c46c79a5b77645fc5" Jul 16 22:45:24.405203 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.405186 2578 scope.go:117] "RemoveContainer" containerID="4ba03c4be6e5325e041441327a5252e65418c52df13cddb2f12807f04bd8467d" Jul 16 22:45:24.413827 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.413798 2578 scope.go:117] "RemoveContainer" containerID="55dc6e014eb7c51a1b13d48522e1e1758d2783c77042219c46c79a5b77645fc5" Jul 16 22:45:24.414062 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:45:24.414042 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55dc6e014eb7c51a1b13d48522e1e1758d2783c77042219c46c79a5b77645fc5\": container with ID starting with 55dc6e014eb7c51a1b13d48522e1e1758d2783c77042219c46c79a5b77645fc5 not found: ID does not exist" containerID="55dc6e014eb7c51a1b13d48522e1e1758d2783c77042219c46c79a5b77645fc5" Jul 16 22:45:24.414154 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.414089 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55dc6e014eb7c51a1b13d48522e1e1758d2783c77042219c46c79a5b77645fc5"} err="failed to get container status \"55dc6e014eb7c51a1b13d48522e1e1758d2783c77042219c46c79a5b77645fc5\": rpc error: code = NotFound desc = could not find container \"55dc6e014eb7c51a1b13d48522e1e1758d2783c77042219c46c79a5b77645fc5\": container with ID starting with 55dc6e014eb7c51a1b13d48522e1e1758d2783c77042219c46c79a5b77645fc5 not found: ID does not exist" Jul 16 22:45:24.414154 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.414114 2578 scope.go:117] "RemoveContainer" containerID="4ba03c4be6e5325e041441327a5252e65418c52df13cddb2f12807f04bd8467d" Jul 16 22:45:24.414373 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:45:24.414355 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ba03c4be6e5325e041441327a5252e65418c52df13cddb2f12807f04bd8467d\": container with ID starting with 4ba03c4be6e5325e041441327a5252e65418c52df13cddb2f12807f04bd8467d not found: ID does not exist" containerID="4ba03c4be6e5325e041441327a5252e65418c52df13cddb2f12807f04bd8467d" Jul 16 22:45:24.414420 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.414385 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba03c4be6e5325e041441327a5252e65418c52df13cddb2f12807f04bd8467d"} err="failed to get container status \"4ba03c4be6e5325e041441327a5252e65418c52df13cddb2f12807f04bd8467d\": rpc error: code = NotFound desc = could not find container \"4ba03c4be6e5325e041441327a5252e65418c52df13cddb2f12807f04bd8467d\": container with ID starting with 4ba03c4be6e5325e041441327a5252e65418c52df13cddb2f12807f04bd8467d not found: ID does not exist" Jul 16 22:45:24.421770 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.421747 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6"] Jul 16 22:45:24.431276 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.431258 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-907fee31-gw-openshift-default-578db764b7-xdlr6"] Jul 16 22:45:24.434853 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.434834 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-podinfo\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:45:24.434933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.434854 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpp9n\" (UniqueName: \"kubernetes.io/projected/5ac8e77b-d6b6-464f-8068-f89125377ef4-kube-api-access-hpp9n\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:45:24.434933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.434866 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-envoy\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:45:24.434933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.434875 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-token\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:45:24.434933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:24.434882 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ac8e77b-d6b6-464f-8068-f89125377ef4-istio-data\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:45:26.430812 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:26.430777 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ac8e77b-d6b6-464f-8068-f89125377ef4" path="/var/lib/kubelet/pods/5ac8e77b-d6b6-464f-8068-f89125377ef4/volumes" Jul 16 22:45:31.508313 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.508278 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56"] Jul 16 22:45:31.508797 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.508715 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" containerName="istio-proxy" Jul 16 22:45:31.508797 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.508727 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" containerName="istio-proxy" Jul 16 22:45:31.508797 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.508739 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac8e77b-d6b6-464f-8068-f89125377ef4" containerName="istio-proxy" Jul 16 22:45:31.508797 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.508744 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac8e77b-d6b6-464f-8068-f89125377ef4" containerName="istio-proxy" Jul 16 22:45:31.508797 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.508765 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac8e77b-d6b6-464f-8068-f89125377ef4" containerName="istio-proxy" Jul 16 22:45:31.508797 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.508772 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac8e77b-d6b6-464f-8068-f89125377ef4" containerName="istio-proxy" Jul 16 22:45:31.509155 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.508844 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8b668f2-f16f-443c-a7cc-1d7bd2f690e6" containerName="istio-proxy" Jul 16 22:45:31.509155 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.508857 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac8e77b-d6b6-464f-8068-f89125377ef4" containerName="istio-proxy" Jul 16 22:45:31.511952 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.511929 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.514626 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.514601 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-667ee841-openshift-default-dockercfg-lrm9m\"" Jul 16 22:45:31.528274 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.528254 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56"] Jul 16 22:45:31.601471 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.601436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lrw2\" (UniqueName: \"kubernetes.io/projected/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-kube-api-access-6lrw2\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.601660 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.601511 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-workload-certs\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.601660 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.601552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-envoy\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.601660 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.601585 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-workload-socket\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.601765 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.601666 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-credential-socket\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.601804 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.601769 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istiod-ca-cert\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.601838 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.601818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-podinfo\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.601871 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.601855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-data\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.601911 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.601888 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-token\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.702595 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.702554 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istiod-ca-cert\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.702595 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.702602 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-podinfo\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.702850 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.702626 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-data\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.702850 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.702658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-token\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.702850 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.702682 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lrw2\" (UniqueName: \"kubernetes.io/projected/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-kube-api-access-6lrw2\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.702850 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.702746 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-workload-certs\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.702850 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.702773 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-envoy\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.702850 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.702810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-workload-socket\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.702850 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.702837 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-credential-socket\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.703256 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.703046 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-data\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.703256 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.703136 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-workload-certs\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.703256 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.703203 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-workload-socket\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.703419 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.703268 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-credential-socket\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.703493 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.703469 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istiod-ca-cert\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.705036 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.705014 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-envoy\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.705330 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.705313 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-podinfo\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.711457 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.711435 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-token\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.711630 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.711613 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lrw2\" (UniqueName: \"kubernetes.io/projected/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-kube-api-access-6lrw2\") pod \"e2e-ait-667ee841-openshift-default-77b6746bdc-26b56\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.822663 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.822587 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:31.960537 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.960511 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56"] Jul 16 22:45:31.962418 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:45:31.962386 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d1c0a5a_c8fc_4899_b8a4_ac8e9ebcd69b.slice/crio-8928d0f99dac0a8cf33b7802de5815fe2dabfe5b5976054e89c2e2c0611b4942 WatchSource:0}: Error finding container 8928d0f99dac0a8cf33b7802de5815fe2dabfe5b5976054e89c2e2c0611b4942: Status 404 returned error can't find the container with id 8928d0f99dac0a8cf33b7802de5815fe2dabfe5b5976054e89c2e2c0611b4942 Jul 16 22:45:31.965160 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.965114 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:45:31.965417 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.965394 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:45:31.965595 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:31.965575 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:45:32.437473 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:32.437439 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" event={"ID":"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b","Type":"ContainerStarted","Data":"a581bff506270324580ca4e44e4d6f52d05ee1ca1e160473908b7b62a70717d7"} Jul 16 22:45:32.437651 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:32.437500 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" event={"ID":"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b","Type":"ContainerStarted","Data":"8928d0f99dac0a8cf33b7802de5815fe2dabfe5b5976054e89c2e2c0611b4942"} Jul 16 22:45:32.460649 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:32.460599 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" podStartSLOduration=1.4605847029999999 podStartE2EDuration="1.460584703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:45:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:45:32.459364758 +0000 UTC m=+1898.562009983" watchObservedRunningTime="2026-07-16 22:45:32.460584703 +0000 UTC m=+1898.563229929" Jul 16 22:45:32.822973 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:32.822935 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:33.827947 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:33.827917 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:34.451131 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:34.451099 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:34.452894 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:34.452867 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:48.529037 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:48.528998 2578 generic.go:356] "Generic (PLEG): container finished" podID="5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" containerID="a581bff506270324580ca4e44e4d6f52d05ee1ca1e160473908b7b62a70717d7" exitCode=0 Jul 16 22:45:48.529458 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:48.529092 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" event={"ID":"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b","Type":"ContainerDied","Data":"a581bff506270324580ca4e44e4d6f52d05ee1ca1e160473908b7b62a70717d7"} Jul 16 22:45:48.529665 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:48.529646 2578 scope.go:117] "RemoveContainer" containerID="a581bff506270324580ca4e44e4d6f52d05ee1ca1e160473908b7b62a70717d7" Jul 16 22:45:48.530766 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:48.530738 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:45:48.530825 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:48.530810 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:45:48.530862 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:48.530851 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:45:49.451627 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:49.451585 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:49.554198 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:49.554160 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" event={"ID":"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b","Type":"ContainerStarted","Data":"0664ab8115a77036ee338df0451d8443e1087fbf169da8314db7441f310d5230"} Jul 16 22:45:49.823622 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:49.823467 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:49.824700 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:49.824663 2578 patch_prober.go:28] interesting pod/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 16 22:45:49.825132 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:49.824745 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" podUID="5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 16 22:45:50.823456 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:50.823411 2578 patch_prober.go:28] interesting pod/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 16 22:45:50.823987 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:50.823498 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" podUID="5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 16 22:45:51.824119 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:51.824052 2578 patch_prober.go:28] interesting pod/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 16 22:45:51.824647 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:51.824147 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" podUID="5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 16 22:45:52.823555 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:52.823508 2578 patch_prober.go:28] interesting pod/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 16 22:45:52.823780 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:52.823583 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" podUID="5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 16 22:45:53.826889 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:53.826852 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:53.827339 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:53.827134 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:53.827923 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:53.827907 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:45:54.435113 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:54.435064 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56"] Jul 16 22:45:54.582340 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:54.582308 2578 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" secret="" err="secret \"e2e-ait-667ee841-openshift-default-dockercfg-lrm9m\" not found" Jul 16 22:45:55.586396 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:45:55.586346 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" podUID="5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" containerName="istio-proxy" containerID="cri-o://0664ab8115a77036ee338df0451d8443e1087fbf169da8314db7441f310d5230" gracePeriod=30 Jul 16 22:46:00.864800 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:00.864772 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:46:01.000437 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.000398 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-envoy\") pod \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " Jul 16 22:46:01.000728 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.000705 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-workload-certs\") pod \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " Jul 16 22:46:01.000924 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.000900 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-credential-socket\") pod \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " Jul 16 22:46:01.001055 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.000948 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lrw2\" (UniqueName: \"kubernetes.io/projected/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-kube-api-access-6lrw2\") pod \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " Jul 16 22:46:01.001055 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.000998 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-podinfo\") pod \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " Jul 16 22:46:01.001201 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.001059 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-workload-socket\") pod \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " Jul 16 22:46:01.001201 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.001093 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" (UID: "5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:46:01.001201 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.001117 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-data\") pod \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " Jul 16 22:46:01.001682 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.001593 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" (UID: "5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:46:01.002792 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.001656 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" (UID: "5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:46:01.002792 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.001693 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-token\") pod \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " Jul 16 22:46:01.002792 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.002029 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istiod-ca-cert\") pod \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\" (UID: \"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b\") " Jul 16 22:46:01.002792 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.002373 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-workload-certs\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:46:01.002792 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.002402 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-credential-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:46:01.002792 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.002415 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-workload-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:46:01.002792 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.002765 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" (UID: "5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:46:01.003751 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.003726 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8"] Jul 16 22:46:01.003957 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.003931 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-kube-api-access-6lrw2" (OuterVolumeSpecName: "kube-api-access-6lrw2") pod "5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" (UID: "5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b"). InnerVolumeSpecName "kube-api-access-6lrw2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:46:01.004462 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.004441 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" containerName="istio-proxy" Jul 16 22:46:01.004577 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.004565 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" containerName="istio-proxy" Jul 16 22:46:01.004699 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.004669 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" containerName="istio-proxy" Jul 16 22:46:01.004699 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.004685 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" containerName="istio-proxy" Jul 16 22:46:01.004887 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.004822 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac8e77b-d6b6-464f-8068-f89125377ef4" containerName="istio-proxy" Jul 16 22:46:01.004887 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.004824 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-data" (OuterVolumeSpecName: "istio-data") pod "5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" (UID: "5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:46:01.004887 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.004836 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" containerName="istio-proxy" Jul 16 22:46:01.004887 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.004877 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" containerName="istio-proxy" Jul 16 22:46:01.005586 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.005557 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" (UID: "5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:46:01.007006 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.006978 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" (UID: "5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 22:46:01.007150 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.007004 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-token" (OuterVolumeSpecName: "istio-token") pod "5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" (UID: "5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:46:01.008509 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.008482 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.011541 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.011523 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-67d0ce59-openshift-default-dockercfg-pf7gg\"" Jul 16 22:46:01.023536 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.023508 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8"] Jul 16 22:46:01.103748 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.103640 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-podinfo\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.103748 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.103695 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-token\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.103987 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.103772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-envoy\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.103987 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.103844 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-workload-socket\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.103987 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.103943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2qtg\" (UniqueName: \"kubernetes.io/projected/bf30efc0-019a-42cf-9dff-46af8a1a069d-kube-api-access-c2qtg\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.104201 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.104025 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-credential-socket\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.104201 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.104115 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-workload-certs\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.104201 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.104146 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-data\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.104201 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.104184 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf30efc0-019a-42cf-9dff-46af8a1a069d-istiod-ca-cert\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.104416 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.104255 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-podinfo\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:46:01.104416 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.104274 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-data\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:46:01.104416 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.104292 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-token\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:46:01.104416 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.104305 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istiod-ca-cert\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:46:01.104416 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.104317 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-istio-envoy\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:46:01.104416 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.104330 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lrw2\" (UniqueName: \"kubernetes.io/projected/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b-kube-api-access-6lrw2\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:46:01.205282 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.205242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-podinfo\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.205468 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.205290 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-token\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.205468 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.205340 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-envoy\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.205468 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.205368 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-workload-socket\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.205468 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.205436 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2qtg\" (UniqueName: \"kubernetes.io/projected/bf30efc0-019a-42cf-9dff-46af8a1a069d-kube-api-access-c2qtg\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.205757 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.205482 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-credential-socket\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.205757 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.205538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-workload-certs\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.205757 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.205563 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-data\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.205757 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.205606 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf30efc0-019a-42cf-9dff-46af8a1a069d-istiod-ca-cert\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.205959 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.205872 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-workload-socket\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.206116 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.206092 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-workload-certs\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.206183 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.206126 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-credential-socket\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.206229 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.206189 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-data\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.206362 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.206340 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf30efc0-019a-42cf-9dff-46af8a1a069d-istiod-ca-cert\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.207706 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.207681 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-envoy\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.207841 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.207823 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-podinfo\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.217324 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.217300 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-token\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.219201 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.219178 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2qtg\" (UniqueName: \"kubernetes.io/projected/bf30efc0-019a-42cf-9dff-46af8a1a069d-kube-api-access-c2qtg\") pod \"e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.337722 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.337680 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:01.484742 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.484713 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8"] Jul 16 22:46:01.486604 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:46:01.486576 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf30efc0_019a_42cf_9dff_46af8a1a069d.slice/crio-5bfdb2b656bcb83b24609eb1826402c42ea1bb3fd2a9cf7a0b955301a3d49549 WatchSource:0}: Error finding container 5bfdb2b656bcb83b24609eb1826402c42ea1bb3fd2a9cf7a0b955301a3d49549: Status 404 returned error can't find the container with id 5bfdb2b656bcb83b24609eb1826402c42ea1bb3fd2a9cf7a0b955301a3d49549 Jul 16 22:46:01.488801 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.488760 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:46:01.488876 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.488840 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:46:01.488876 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.488868 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:46:01.625904 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.625865 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" event={"ID":"bf30efc0-019a-42cf-9dff-46af8a1a069d","Type":"ContainerStarted","Data":"26faccd4ae0aff73927974ead35b15e21e4a496fb7005b5268754a57275cf82f"} Jul 16 22:46:01.626114 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.625926 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" event={"ID":"bf30efc0-019a-42cf-9dff-46af8a1a069d","Type":"ContainerStarted","Data":"5bfdb2b656bcb83b24609eb1826402c42ea1bb3fd2a9cf7a0b955301a3d49549"} Jul 16 22:46:01.627798 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.627772 2578 generic.go:356] "Generic (PLEG): container finished" podID="5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" containerID="0664ab8115a77036ee338df0451d8443e1087fbf169da8314db7441f310d5230" exitCode=0 Jul 16 22:46:01.627942 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.627820 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" Jul 16 22:46:01.627942 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.627827 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" event={"ID":"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b","Type":"ContainerDied","Data":"0664ab8115a77036ee338df0451d8443e1087fbf169da8314db7441f310d5230"} Jul 16 22:46:01.627942 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.627874 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56" event={"ID":"5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b","Type":"ContainerDied","Data":"8928d0f99dac0a8cf33b7802de5815fe2dabfe5b5976054e89c2e2c0611b4942"} Jul 16 22:46:01.627942 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.627898 2578 scope.go:117] "RemoveContainer" containerID="0664ab8115a77036ee338df0451d8443e1087fbf169da8314db7441f310d5230" Jul 16 22:46:01.636820 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.636802 2578 scope.go:117] "RemoveContainer" containerID="a581bff506270324580ca4e44e4d6f52d05ee1ca1e160473908b7b62a70717d7" Jul 16 22:46:01.645280 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.645263 2578 scope.go:117] "RemoveContainer" containerID="0664ab8115a77036ee338df0451d8443e1087fbf169da8314db7441f310d5230" Jul 16 22:46:01.645557 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:46:01.645538 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0664ab8115a77036ee338df0451d8443e1087fbf169da8314db7441f310d5230\": container with ID starting with 0664ab8115a77036ee338df0451d8443e1087fbf169da8314db7441f310d5230 not found: ID does not exist" containerID="0664ab8115a77036ee338df0451d8443e1087fbf169da8314db7441f310d5230" Jul 16 22:46:01.645626 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.645570 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0664ab8115a77036ee338df0451d8443e1087fbf169da8314db7441f310d5230"} err="failed to get container status \"0664ab8115a77036ee338df0451d8443e1087fbf169da8314db7441f310d5230\": rpc error: code = NotFound desc = could not find container \"0664ab8115a77036ee338df0451d8443e1087fbf169da8314db7441f310d5230\": container with ID starting with 0664ab8115a77036ee338df0451d8443e1087fbf169da8314db7441f310d5230 not found: ID does not exist" Jul 16 22:46:01.645626 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.645596 2578 scope.go:117] "RemoveContainer" containerID="a581bff506270324580ca4e44e4d6f52d05ee1ca1e160473908b7b62a70717d7" Jul 16 22:46:01.645871 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:46:01.645848 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a581bff506270324580ca4e44e4d6f52d05ee1ca1e160473908b7b62a70717d7\": container with ID starting with a581bff506270324580ca4e44e4d6f52d05ee1ca1e160473908b7b62a70717d7 not found: ID does not exist" containerID="a581bff506270324580ca4e44e4d6f52d05ee1ca1e160473908b7b62a70717d7" Jul 16 22:46:01.645915 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.645879 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a581bff506270324580ca4e44e4d6f52d05ee1ca1e160473908b7b62a70717d7"} err="failed to get container status \"a581bff506270324580ca4e44e4d6f52d05ee1ca1e160473908b7b62a70717d7\": rpc error: code = NotFound desc = could not find container \"a581bff506270324580ca4e44e4d6f52d05ee1ca1e160473908b7b62a70717d7\": container with ID starting with a581bff506270324580ca4e44e4d6f52d05ee1ca1e160473908b7b62a70717d7 not found: ID does not exist" Jul 16 22:46:01.650502 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.650455 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" podStartSLOduration=1.650437416 podStartE2EDuration="1.650437416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:46:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:46:01.647402167 +0000 UTC m=+1927.750047410" watchObservedRunningTime="2026-07-16 22:46:01.650437416 +0000 UTC m=+1927.753082643" Jul 16 22:46:01.663788 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.663762 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56"] Jul 16 22:46:01.672335 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:01.672306 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-667ee841-openshift-default-77b6746bdc-26b56"] Jul 16 22:46:02.338156 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:02.338122 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:02.344180 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:02.344150 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:02.430983 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:02.430948 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b" path="/var/lib/kubelet/pods/5d1c0a5a-c8fc-4899-b8a4-ac8e9ebcd69b/volumes" Jul 16 22:46:02.634895 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:02.634805 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:02.635838 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:02.635816 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:16.706697 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:16.706658 2578 generic.go:356] "Generic (PLEG): container finished" podID="bf30efc0-019a-42cf-9dff-46af8a1a069d" containerID="26faccd4ae0aff73927974ead35b15e21e4a496fb7005b5268754a57275cf82f" exitCode=0 Jul 16 22:46:16.707345 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:16.706735 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" event={"ID":"bf30efc0-019a-42cf-9dff-46af8a1a069d","Type":"ContainerDied","Data":"26faccd4ae0aff73927974ead35b15e21e4a496fb7005b5268754a57275cf82f"} Jul 16 22:46:16.707345 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:16.707314 2578 scope.go:117] "RemoveContainer" containerID="26faccd4ae0aff73927974ead35b15e21e4a496fb7005b5268754a57275cf82f" Jul 16 22:46:16.708386 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:16.708360 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:46:16.708459 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:16.708427 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:46:16.708497 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:16.708460 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:46:17.635392 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:17.635340 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:17.713923 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:17.713888 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" event={"ID":"bf30efc0-019a-42cf-9dff-46af8a1a069d","Type":"ContainerStarted","Data":"9979fdc15909d6d9c50e19762e228198cb5f058a6024892f2e9ce80449db95db"} Jul 16 22:46:18.338322 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:18.338250 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:18.339516 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:18.339476 2578 patch_prober.go:28] interesting pod/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 16 22:46:18.339669 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:18.339540 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" podUID="bf30efc0-019a-42cf-9dff-46af8a1a069d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 16 22:46:19.338496 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:19.338456 2578 patch_prober.go:28] interesting pod/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 16 22:46:19.339156 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:19.339122 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" podUID="bf30efc0-019a-42cf-9dff-46af8a1a069d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 16 22:46:20.338092 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:20.338033 2578 patch_prober.go:28] interesting pod/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 16 22:46:20.338394 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:20.338354 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" podUID="bf30efc0-019a-42cf-9dff-46af8a1a069d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 16 22:46:21.338641 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:21.338595 2578 patch_prober.go:28] interesting pod/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 16 22:46:21.339300 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:21.339263 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" podUID="bf30efc0-019a-42cf-9dff-46af8a1a069d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 16 22:46:22.342909 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:22.342880 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:22.343404 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:22.343188 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:46:22.343781 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:46:22.343763 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:47:21.935515 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:21.935483 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8"] Jul 16 22:47:21.936023 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:21.935700 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" podUID="bf30efc0-019a-42cf-9dff-46af8a1a069d" containerName="istio-proxy" containerID="cri-o://9979fdc15909d6d9c50e19762e228198cb5f058a6024892f2e9ce80449db95db" gracePeriod=30 Jul 16 22:47:22.345177 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:22.345131 2578 patch_prober.go:28] interesting pod/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 16 22:47:22.345347 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:22.345212 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" podUID="bf30efc0-019a-42cf-9dff-46af8a1a069d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 22:47:27.089547 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.089511 2578 generic.go:356] "Generic (PLEG): container finished" podID="bf30efc0-019a-42cf-9dff-46af8a1a069d" containerID="9979fdc15909d6d9c50e19762e228198cb5f058a6024892f2e9ce80449db95db" exitCode=0 Jul 16 22:47:27.089547 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.089537 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" event={"ID":"bf30efc0-019a-42cf-9dff-46af8a1a069d","Type":"ContainerDied","Data":"9979fdc15909d6d9c50e19762e228198cb5f058a6024892f2e9ce80449db95db"} Jul 16 22:47:27.090035 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.089603 2578 scope.go:117] "RemoveContainer" containerID="26faccd4ae0aff73927974ead35b15e21e4a496fb7005b5268754a57275cf82f" Jul 16 22:47:27.204660 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.204600 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:47:27.354253 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.354218 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-workload-certs\") pod \"bf30efc0-019a-42cf-9dff-46af8a1a069d\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " Jul 16 22:47:27.354253 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.354256 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-credential-socket\") pod \"bf30efc0-019a-42cf-9dff-46af8a1a069d\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " Jul 16 22:47:27.354472 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.354286 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-token\") pod \"bf30efc0-019a-42cf-9dff-46af8a1a069d\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " Jul 16 22:47:27.354472 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.354331 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-envoy\") pod \"bf30efc0-019a-42cf-9dff-46af8a1a069d\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " Jul 16 22:47:27.354472 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.354355 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-podinfo\") pod \"bf30efc0-019a-42cf-9dff-46af8a1a069d\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " Jul 16 22:47:27.354472 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.354396 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf30efc0-019a-42cf-9dff-46af8a1a069d-istiod-ca-cert\") pod \"bf30efc0-019a-42cf-9dff-46af8a1a069d\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " Jul 16 22:47:27.354472 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.354458 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-workload-socket\") pod \"bf30efc0-019a-42cf-9dff-46af8a1a069d\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " Jul 16 22:47:27.354742 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.354504 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2qtg\" (UniqueName: \"kubernetes.io/projected/bf30efc0-019a-42cf-9dff-46af8a1a069d-kube-api-access-c2qtg\") pod \"bf30efc0-019a-42cf-9dff-46af8a1a069d\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " Jul 16 22:47:27.354742 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.354512 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bf30efc0-019a-42cf-9dff-46af8a1a069d" (UID: "bf30efc0-019a-42cf-9dff-46af8a1a069d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:47:27.354742 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.354535 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-data\") pod \"bf30efc0-019a-42cf-9dff-46af8a1a069d\" (UID: \"bf30efc0-019a-42cf-9dff-46af8a1a069d\") " Jul 16 22:47:27.354742 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.354545 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bf30efc0-019a-42cf-9dff-46af8a1a069d" (UID: "bf30efc0-019a-42cf-9dff-46af8a1a069d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:47:27.354742 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.354710 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bf30efc0-019a-42cf-9dff-46af8a1a069d" (UID: "bf30efc0-019a-42cf-9dff-46af8a1a069d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:47:27.354903 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.354849 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-workload-certs\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:47:27.354903 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.354863 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-credential-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:47:27.354903 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.354875 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-workload-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:47:27.354995 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.354973 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf30efc0-019a-42cf-9dff-46af8a1a069d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bf30efc0-019a-42cf-9dff-46af8a1a069d" (UID: "bf30efc0-019a-42cf-9dff-46af8a1a069d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:47:27.355515 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.355491 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-data" (OuterVolumeSpecName: "istio-data") pod "bf30efc0-019a-42cf-9dff-46af8a1a069d" (UID: "bf30efc0-019a-42cf-9dff-46af8a1a069d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:47:27.356895 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.356867 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-token" (OuterVolumeSpecName: "istio-token") pod "bf30efc0-019a-42cf-9dff-46af8a1a069d" (UID: "bf30efc0-019a-42cf-9dff-46af8a1a069d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:47:27.357025 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.356924 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf30efc0-019a-42cf-9dff-46af8a1a069d-kube-api-access-c2qtg" (OuterVolumeSpecName: "kube-api-access-c2qtg") pod "bf30efc0-019a-42cf-9dff-46af8a1a069d" (UID: "bf30efc0-019a-42cf-9dff-46af8a1a069d"). InnerVolumeSpecName "kube-api-access-c2qtg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:47:27.357165 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.357141 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bf30efc0-019a-42cf-9dff-46af8a1a069d" (UID: "bf30efc0-019a-42cf-9dff-46af8a1a069d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 22:47:27.357266 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.357246 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bf30efc0-019a-42cf-9dff-46af8a1a069d" (UID: "bf30efc0-019a-42cf-9dff-46af8a1a069d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:47:27.455469 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.455385 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf30efc0-019a-42cf-9dff-46af8a1a069d-istiod-ca-cert\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:47:27.455469 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.455413 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2qtg\" (UniqueName: \"kubernetes.io/projected/bf30efc0-019a-42cf-9dff-46af8a1a069d-kube-api-access-c2qtg\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:47:27.455469 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.455424 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-data\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:47:27.455469 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.455432 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-token\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:47:27.455469 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.455441 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-envoy\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:47:27.455469 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:27.455448 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf30efc0-019a-42cf-9dff-46af8a1a069d-istio-podinfo\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:47:28.102913 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:28.102877 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" event={"ID":"bf30efc0-019a-42cf-9dff-46af8a1a069d","Type":"ContainerDied","Data":"5bfdb2b656bcb83b24609eb1826402c42ea1bb3fd2a9cf7a0b955301a3d49549"} Jul 16 22:47:28.103373 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:28.102916 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8" Jul 16 22:47:28.103373 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:28.102957 2578 scope.go:117] "RemoveContainer" containerID="9979fdc15909d6d9c50e19762e228198cb5f058a6024892f2e9ce80449db95db" Jul 16 22:47:28.137876 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:28.137822 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8"] Jul 16 22:47:28.148780 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:28.148756 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-67d0ce59-openshift-default-559bdcc7f5-vqls8"] Jul 16 22:47:28.433738 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:47:28.433708 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf30efc0-019a-42cf-9dff-46af8a1a069d" path="/var/lib/kubelet/pods/bf30efc0-019a-42cf-9dff-46af8a1a069d/volumes" Jul 16 22:48:58.820162 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:48:58.820128 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:48:58.832953 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:48:58.832930 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:49:06.711298 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.711265 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk"] Jul 16 22:49:06.711688 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.711675 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf30efc0-019a-42cf-9dff-46af8a1a069d" containerName="istio-proxy" Jul 16 22:49:06.711736 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.711692 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf30efc0-019a-42cf-9dff-46af8a1a069d" containerName="istio-proxy" Jul 16 22:49:06.711736 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.711702 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf30efc0-019a-42cf-9dff-46af8a1a069d" containerName="istio-proxy" Jul 16 22:49:06.711736 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.711708 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf30efc0-019a-42cf-9dff-46af8a1a069d" containerName="istio-proxy" Jul 16 22:49:06.711835 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.711784 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf30efc0-019a-42cf-9dff-46af8a1a069d" containerName="istio-proxy" Jul 16 22:49:06.714770 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.714753 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.719712 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.719692 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0f02bfcd-openshift-default-dockercfg-bkmqk\"" Jul 16 22:49:06.745605 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.745579 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk"] Jul 16 22:49:06.789834 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.789800 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlxcs\" (UniqueName: \"kubernetes.io/projected/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-kube-api-access-dlxcs\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.789958 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.789854 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-data\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.789958 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.789885 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-workload-socket\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.790111 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.789969 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-workload-certs\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.790111 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.790019 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-envoy\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.790111 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.790098 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-podinfo\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.790275 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.790130 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-credential-socket\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.790275 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.790157 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-token\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.790275 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.790189 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istiod-ca-cert\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.891254 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.891219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-workload-certs\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.891446 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.891272 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-envoy\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.891446 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.891308 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-podinfo\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.891446 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.891327 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-credential-socket\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.891446 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.891345 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-token\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.891446 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.891371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istiod-ca-cert\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.891446 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.891401 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlxcs\" (UniqueName: \"kubernetes.io/projected/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-kube-api-access-dlxcs\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.891446 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.891440 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-data\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.891831 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.891470 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-workload-socket\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.891831 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.891682 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-workload-certs\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.891935 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.891847 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-credential-socket\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.891935 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.891884 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-workload-socket\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.891935 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.891923 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-data\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.892116 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.892050 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istiod-ca-cert\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.893711 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.893686 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-envoy\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.894045 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.894028 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-podinfo\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.907899 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.907865 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-token\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:06.908014 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:06.907960 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlxcs\" (UniqueName: \"kubernetes.io/projected/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-kube-api-access-dlxcs\") pod \"e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:07.024742 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:07.024652 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:07.162326 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:07.162298 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk"] Jul 16 22:49:07.164619 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:49:07.164591 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d03e21_8fe5_4f6d_b43e_6ff45557a02d.slice/crio-0e9d0d5fbd532060cff40c7314c0f26dba8de53af524f9d297f9797b92b7f096 WatchSource:0}: Error finding container 0e9d0d5fbd532060cff40c7314c0f26dba8de53af524f9d297f9797b92b7f096: Status 404 returned error can't find the container with id 0e9d0d5fbd532060cff40c7314c0f26dba8de53af524f9d297f9797b92b7f096 Jul 16 22:49:07.166642 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:07.166608 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:49:07.166716 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:07.166675 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:49:07.166716 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:07.166703 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:49:07.621170 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:07.621137 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" event={"ID":"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d","Type":"ContainerStarted","Data":"d468af9da2a2aa78e18fa613ad6cf597274e1762f996ff77031cd8467da58c02"} Jul 16 22:49:07.621383 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:07.621199 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" event={"ID":"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d","Type":"ContainerStarted","Data":"0e9d0d5fbd532060cff40c7314c0f26dba8de53af524f9d297f9797b92b7f096"} Jul 16 22:49:07.660411 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:07.660356 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" podStartSLOduration=1.6603408819999999 podStartE2EDuration="1.660340882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:49:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:49:07.659294855 +0000 UTC m=+2113.761940098" watchObservedRunningTime="2026-07-16 22:49:07.660340882 +0000 UTC m=+2113.762986107" Jul 16 22:49:08.025943 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:08.025906 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:08.030616 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:08.030588 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:08.626314 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:08.626284 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:08.627318 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:08.627293 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:21.694870 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:21.694837 2578 generic.go:356] "Generic (PLEG): container finished" podID="f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" containerID="d468af9da2a2aa78e18fa613ad6cf597274e1762f996ff77031cd8467da58c02" exitCode=0 Jul 16 22:49:21.695340 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:21.694905 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" event={"ID":"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d","Type":"ContainerDied","Data":"d468af9da2a2aa78e18fa613ad6cf597274e1762f996ff77031cd8467da58c02"} Jul 16 22:49:21.695340 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:21.695317 2578 scope.go:117] "RemoveContainer" containerID="d468af9da2a2aa78e18fa613ad6cf597274e1762f996ff77031cd8467da58c02" Jul 16 22:49:21.696323 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:21.696297 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:49:21.696395 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:21.696362 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:49:21.696438 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:21.696392 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:49:22.708989 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:22.708955 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" event={"ID":"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d","Type":"ContainerStarted","Data":"dbf9c8699517aa12834f7bfb55b9c235b38675dd4822736097ccd2d52ff1d865"} Jul 16 22:49:23.025769 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:23.025607 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:23.026557 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:23.026521 2578 patch_prober.go:28] interesting pod/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 16 22:49:23.026713 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:23.026589 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" podUID="f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 16 22:49:23.626458 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:23.626417 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:24.025855 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:24.025812 2578 patch_prober.go:28] interesting pod/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 16 22:49:24.026422 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:24.025887 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" podUID="f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 16 22:49:25.025400 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:25.025356 2578 patch_prober.go:28] interesting pod/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 16 22:49:25.025599 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:25.025423 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" podUID="f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 16 22:49:26.025365 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:26.025327 2578 patch_prober.go:28] interesting pod/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 16 22:49:26.025967 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:26.025933 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" podUID="f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 16 22:49:27.029329 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:27.029293 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:27.030175 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:27.030152 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:43.280892 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:43.280858 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk"] Jul 16 22:49:43.281462 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:43.281092 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" podUID="f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" containerName="istio-proxy" containerID="cri-o://dbf9c8699517aa12834f7bfb55b9c235b38675dd4822736097ccd2d52ff1d865" gracePeriod=30 Jul 16 22:49:48.541403 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.541338 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:48.596004 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.595973 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-podinfo\") pod \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " Jul 16 22:49:48.596204 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.596034 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-envoy\") pod \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " Jul 16 22:49:48.596204 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.596094 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-workload-certs\") pod \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " Jul 16 22:49:48.596204 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.596110 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istiod-ca-cert\") pod \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " Jul 16 22:49:48.596204 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.596157 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-data\") pod \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " Jul 16 22:49:48.596204 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.596202 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-workload-socket\") pod \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " Jul 16 22:49:48.596477 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.596234 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-credential-socket\") pod \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " Jul 16 22:49:48.596477 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.596264 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlxcs\" (UniqueName: \"kubernetes.io/projected/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-kube-api-access-dlxcs\") pod \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " Jul 16 22:49:48.596477 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.596305 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-token\") pod \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\" (UID: \"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d\") " Jul 16 22:49:48.596477 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.596395 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" (UID: "f4d03e21-8fe5-4f6d-b43e-6ff45557a02d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:49:48.596704 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.596575 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" (UID: "f4d03e21-8fe5-4f6d-b43e-6ff45557a02d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:49:48.596704 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.596683 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-workload-certs\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:49:48.596813 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.596770 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" (UID: "f4d03e21-8fe5-4f6d-b43e-6ff45557a02d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:49:48.596871 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.596847 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" (UID: "f4d03e21-8fe5-4f6d-b43e-6ff45557a02d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:49:48.597394 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.597367 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-data" (OuterVolumeSpecName: "istio-data") pod "f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" (UID: "f4d03e21-8fe5-4f6d-b43e-6ff45557a02d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:49:48.598529 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.598502 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-token" (OuterVolumeSpecName: "istio-token") pod "f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" (UID: "f4d03e21-8fe5-4f6d-b43e-6ff45557a02d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:49:48.598746 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.598722 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" (UID: "f4d03e21-8fe5-4f6d-b43e-6ff45557a02d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 22:49:48.598842 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.598733 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" (UID: "f4d03e21-8fe5-4f6d-b43e-6ff45557a02d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:49:48.599140 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.599124 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-kube-api-access-dlxcs" (OuterVolumeSpecName: "kube-api-access-dlxcs") pod "f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" (UID: "f4d03e21-8fe5-4f6d-b43e-6ff45557a02d"). InnerVolumeSpecName "kube-api-access-dlxcs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:49:48.697974 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.697931 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-podinfo\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:49:48.697974 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.697970 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-envoy\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:49:48.697974 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.697980 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istiod-ca-cert\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:49:48.697974 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.697988 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-data\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:49:48.698276 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.697995 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-workload-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:49:48.698276 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.698004 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-credential-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:49:48.698276 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.698013 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlxcs\" (UniqueName: \"kubernetes.io/projected/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-kube-api-access-dlxcs\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:49:48.698276 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.698022 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d-istio-token\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:49:48.853782 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.853690 2578 generic.go:356] "Generic (PLEG): container finished" podID="f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" containerID="dbf9c8699517aa12834f7bfb55b9c235b38675dd4822736097ccd2d52ff1d865" exitCode=0 Jul 16 22:49:48.853782 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.853734 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" event={"ID":"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d","Type":"ContainerDied","Data":"dbf9c8699517aa12834f7bfb55b9c235b38675dd4822736097ccd2d52ff1d865"} Jul 16 22:49:48.853782 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.853739 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" Jul 16 22:49:48.854028 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.853785 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk" event={"ID":"f4d03e21-8fe5-4f6d-b43e-6ff45557a02d","Type":"ContainerDied","Data":"0e9d0d5fbd532060cff40c7314c0f26dba8de53af524f9d297f9797b92b7f096"} Jul 16 22:49:48.854028 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.853810 2578 scope.go:117] "RemoveContainer" containerID="dbf9c8699517aa12834f7bfb55b9c235b38675dd4822736097ccd2d52ff1d865" Jul 16 22:49:48.863144 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.863125 2578 scope.go:117] "RemoveContainer" containerID="d468af9da2a2aa78e18fa613ad6cf597274e1762f996ff77031cd8467da58c02" Jul 16 22:49:48.871721 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.871704 2578 scope.go:117] "RemoveContainer" containerID="dbf9c8699517aa12834f7bfb55b9c235b38675dd4822736097ccd2d52ff1d865" Jul 16 22:49:48.871971 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:49:48.871951 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbf9c8699517aa12834f7bfb55b9c235b38675dd4822736097ccd2d52ff1d865\": container with ID starting with dbf9c8699517aa12834f7bfb55b9c235b38675dd4822736097ccd2d52ff1d865 not found: ID does not exist" containerID="dbf9c8699517aa12834f7bfb55b9c235b38675dd4822736097ccd2d52ff1d865" Jul 16 22:49:48.872021 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.871979 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbf9c8699517aa12834f7bfb55b9c235b38675dd4822736097ccd2d52ff1d865"} err="failed to get container status \"dbf9c8699517aa12834f7bfb55b9c235b38675dd4822736097ccd2d52ff1d865\": rpc error: code = NotFound desc = could not find container \"dbf9c8699517aa12834f7bfb55b9c235b38675dd4822736097ccd2d52ff1d865\": container with ID starting with dbf9c8699517aa12834f7bfb55b9c235b38675dd4822736097ccd2d52ff1d865 not found: ID does not exist" Jul 16 22:49:48.872021 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.871996 2578 scope.go:117] "RemoveContainer" containerID="d468af9da2a2aa78e18fa613ad6cf597274e1762f996ff77031cd8467da58c02" Jul 16 22:49:48.872275 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:49:48.872258 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d468af9da2a2aa78e18fa613ad6cf597274e1762f996ff77031cd8467da58c02\": container with ID starting with d468af9da2a2aa78e18fa613ad6cf597274e1762f996ff77031cd8467da58c02 not found: ID does not exist" containerID="d468af9da2a2aa78e18fa613ad6cf597274e1762f996ff77031cd8467da58c02" Jul 16 22:49:48.872329 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.872281 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d468af9da2a2aa78e18fa613ad6cf597274e1762f996ff77031cd8467da58c02"} err="failed to get container status \"d468af9da2a2aa78e18fa613ad6cf597274e1762f996ff77031cd8467da58c02\": rpc error: code = NotFound desc = could not find container \"d468af9da2a2aa78e18fa613ad6cf597274e1762f996ff77031cd8467da58c02\": container with ID starting with d468af9da2a2aa78e18fa613ad6cf597274e1762f996ff77031cd8467da58c02 not found: ID does not exist" Jul 16 22:49:48.876615 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.876593 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk"] Jul 16 22:49:48.880374 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:48.880354 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0f02bfcd-openshift-default-5475cc46cf-75fnk"] Jul 16 22:49:50.436849 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:49:50.436810 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" path="/var/lib/kubelet/pods/f4d03e21-8fe5-4f6d-b43e-6ff45557a02d/volumes" Jul 16 22:50:03.158800 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.158766 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz"] Jul 16 22:50:03.159241 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.159227 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" containerName="istio-proxy" Jul 16 22:50:03.159288 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.159244 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" containerName="istio-proxy" Jul 16 22:50:03.159288 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.159253 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" containerName="istio-proxy" Jul 16 22:50:03.159288 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.159259 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" containerName="istio-proxy" Jul 16 22:50:03.159381 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.159343 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf30efc0-019a-42cf-9dff-46af8a1a069d" containerName="istio-proxy" Jul 16 22:50:03.159381 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.159353 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" containerName="istio-proxy" Jul 16 22:50:03.159381 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.159359 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4d03e21-8fe5-4f6d-b43e-6ff45557a02d" containerName="istio-proxy" Jul 16 22:50:03.162446 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.162428 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.166688 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.166668 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8a492916-openshift-default-dockercfg-fsvnb\"" Jul 16 22:50:03.179610 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.179586 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz"] Jul 16 22:50:03.236221 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.236175 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dae18372-f73e-4482-ac3e-44e61672f0e2-istiod-ca-cert\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.236221 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.236210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-token\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.236485 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.236237 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-workload-certs\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.236485 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.236318 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-credential-socket\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.236485 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.236354 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmk28\" (UniqueName: \"kubernetes.io/projected/dae18372-f73e-4482-ac3e-44e61672f0e2-kube-api-access-jmk28\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.236485 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.236438 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-workload-socket\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.236694 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.236555 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-envoy\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.236694 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.236615 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-podinfo\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.236798 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.236695 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-data\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.337773 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.337728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-podinfo\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.337959 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.337892 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-data\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.337959 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.337937 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dae18372-f73e-4482-ac3e-44e61672f0e2-istiod-ca-cert\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.337959 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.337958 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-token\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.338174 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.337986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-workload-certs\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.338174 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.338012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-credential-socket\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.338174 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.338029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmk28\" (UniqueName: \"kubernetes.io/projected/dae18372-f73e-4482-ac3e-44e61672f0e2-kube-api-access-jmk28\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.338174 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.338058 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-workload-socket\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.338174 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.338174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-envoy\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.338444 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.338364 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-data\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.338603 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.338563 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-credential-socket\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.338731 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.338608 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-workload-certs\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.338731 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.338621 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-workload-socket\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.338731 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.338723 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dae18372-f73e-4482-ac3e-44e61672f0e2-istiod-ca-cert\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.340282 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.340266 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-envoy\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.340589 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.340571 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-podinfo\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.347742 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.347719 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-token\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.347914 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.347891 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmk28\" (UniqueName: \"kubernetes.io/projected/dae18372-f73e-4482-ac3e-44e61672f0e2-kube-api-access-jmk28\") pod \"e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.472440 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.472406 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:03.611511 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.611484 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz"] Jul 16 22:50:03.613384 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:50:03.613361 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae18372_f73e_4482_ac3e_44e61672f0e2.slice/crio-3d1f227729f1bc4e1c3dc297271471829aa2c8d2e5b277a8aaba9f44382a3b4c WatchSource:0}: Error finding container 3d1f227729f1bc4e1c3dc297271471829aa2c8d2e5b277a8aaba9f44382a3b4c: Status 404 returned error can't find the container with id 3d1f227729f1bc4e1c3dc297271471829aa2c8d2e5b277a8aaba9f44382a3b4c Jul 16 22:50:03.615894 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.615860 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:50:03.615976 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.615924 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:50:03.615976 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.615957 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:50:03.934567 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.934463 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" event={"ID":"dae18372-f73e-4482-ac3e-44e61672f0e2","Type":"ContainerStarted","Data":"c34cc978d9a16aa77c8e3085f014445e0b6ac09cd099a2dccd130f117eddb432"} Jul 16 22:50:03.934567 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.934535 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" event={"ID":"dae18372-f73e-4482-ac3e-44e61672f0e2","Type":"ContainerStarted","Data":"3d1f227729f1bc4e1c3dc297271471829aa2c8d2e5b277a8aaba9f44382a3b4c"} Jul 16 22:50:03.962857 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:03.962796 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" podStartSLOduration=0.962779199 podStartE2EDuration="962.779199ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:50:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:50:03.961406133 +0000 UTC m=+2170.064051359" watchObservedRunningTime="2026-07-16 22:50:03.962779199 +0000 UTC m=+2170.065424425" Jul 16 22:50:04.473527 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:04.473496 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:04.478335 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:04.478311 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:04.939395 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:04.939318 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:04.940311 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:04.940290 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:19.009148 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:19.009119 2578 generic.go:356] "Generic (PLEG): container finished" podID="dae18372-f73e-4482-ac3e-44e61672f0e2" containerID="c34cc978d9a16aa77c8e3085f014445e0b6ac09cd099a2dccd130f117eddb432" exitCode=0 Jul 16 22:50:19.009488 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:19.009197 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" event={"ID":"dae18372-f73e-4482-ac3e-44e61672f0e2","Type":"ContainerDied","Data":"c34cc978d9a16aa77c8e3085f014445e0b6ac09cd099a2dccd130f117eddb432"} Jul 16 22:50:19.009610 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:19.009596 2578 scope.go:117] "RemoveContainer" containerID="c34cc978d9a16aa77c8e3085f014445e0b6ac09cd099a2dccd130f117eddb432" Jul 16 22:50:19.010698 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:19.010671 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:50:19.010762 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:19.010740 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:50:19.010798 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:19.010777 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:50:19.939957 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:19.939892 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:20.015580 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:20.015542 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" event={"ID":"dae18372-f73e-4482-ac3e-44e61672f0e2","Type":"ContainerStarted","Data":"e210645996009776ec3ac80a64ddf9d69e39d4aa95ca93ba8847376669271651"} Jul 16 22:50:20.473063 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:20.473033 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:20.474266 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:20.474238 2578 patch_prober.go:28] interesting pod/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 16 22:50:20.474406 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:20.474286 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" podUID="dae18372-f73e-4482-ac3e-44e61672f0e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 16 22:50:21.472774 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:21.472736 2578 patch_prober.go:28] interesting pod/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 16 22:50:21.473190 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:21.472790 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" podUID="dae18372-f73e-4482-ac3e-44e61672f0e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 16 22:50:22.473088 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:22.473042 2578 patch_prober.go:28] interesting pod/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 16 22:50:22.473484 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:22.473114 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" podUID="dae18372-f73e-4482-ac3e-44e61672f0e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 16 22:50:23.473766 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:23.473724 2578 patch_prober.go:28] interesting pod/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 16 22:50:23.474276 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:23.473794 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" podUID="dae18372-f73e-4482-ac3e-44e61672f0e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 16 22:50:24.477665 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:24.477635 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:24.478043 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:24.477911 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:50:24.478684 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:50:24.478663 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:52:05.161500 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:05.161465 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz"] Jul 16 22:52:05.162721 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:05.162679 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" podUID="dae18372-f73e-4482-ac3e-44e61672f0e2" containerName="istio-proxy" containerID="cri-o://e210645996009776ec3ac80a64ddf9d69e39d4aa95ca93ba8847376669271651" gracePeriod=30 Jul 16 22:52:09.480679 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:09.480641 2578 patch_prober.go:28] interesting pod/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 16 22:52:09.481054 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:09.480713 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" podUID="dae18372-f73e-4482-ac3e-44e61672f0e2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 22:52:10.422198 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.422174 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:52:10.492852 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.492821 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dae18372-f73e-4482-ac3e-44e61672f0e2-istiod-ca-cert\") pod \"dae18372-f73e-4482-ac3e-44e61672f0e2\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " Jul 16 22:52:10.493364 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.492938 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-workload-certs\") pod \"dae18372-f73e-4482-ac3e-44e61672f0e2\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " Jul 16 22:52:10.493364 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.492985 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmk28\" (UniqueName: \"kubernetes.io/projected/dae18372-f73e-4482-ac3e-44e61672f0e2-kube-api-access-jmk28\") pod \"dae18372-f73e-4482-ac3e-44e61672f0e2\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " Jul 16 22:52:10.493364 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.493021 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-data\") pod \"dae18372-f73e-4482-ac3e-44e61672f0e2\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " Jul 16 22:52:10.493364 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.493106 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-envoy\") pod \"dae18372-f73e-4482-ac3e-44e61672f0e2\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " Jul 16 22:52:10.493364 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.493138 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-podinfo\") pod \"dae18372-f73e-4482-ac3e-44e61672f0e2\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " Jul 16 22:52:10.493364 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.493175 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-token\") pod \"dae18372-f73e-4482-ac3e-44e61672f0e2\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " Jul 16 22:52:10.493364 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.493205 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-credential-socket\") pod \"dae18372-f73e-4482-ac3e-44e61672f0e2\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " Jul 16 22:52:10.493364 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.493242 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-workload-socket\") pod \"dae18372-f73e-4482-ac3e-44e61672f0e2\" (UID: \"dae18372-f73e-4482-ac3e-44e61672f0e2\") " Jul 16 22:52:10.493364 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.493288 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dae18372-f73e-4482-ac3e-44e61672f0e2" (UID: "dae18372-f73e-4482-ac3e-44e61672f0e2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:52:10.493364 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.493288 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dae18372-f73e-4482-ac3e-44e61672f0e2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dae18372-f73e-4482-ac3e-44e61672f0e2" (UID: "dae18372-f73e-4482-ac3e-44e61672f0e2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:52:10.493859 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.493495 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dae18372-f73e-4482-ac3e-44e61672f0e2" (UID: "dae18372-f73e-4482-ac3e-44e61672f0e2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:52:10.493859 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.493617 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-workload-certs\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:52:10.493859 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.493635 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-credential-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:52:10.493859 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.493677 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dae18372-f73e-4482-ac3e-44e61672f0e2-istiod-ca-cert\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:52:10.493859 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.493705 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dae18372-f73e-4482-ac3e-44e61672f0e2" (UID: "dae18372-f73e-4482-ac3e-44e61672f0e2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:52:10.494022 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.493938 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-data" (OuterVolumeSpecName: "istio-data") pod "dae18372-f73e-4482-ac3e-44e61672f0e2" (UID: "dae18372-f73e-4482-ac3e-44e61672f0e2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:52:10.495301 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.495276 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dae18372-f73e-4482-ac3e-44e61672f0e2-kube-api-access-jmk28" (OuterVolumeSpecName: "kube-api-access-jmk28") pod "dae18372-f73e-4482-ac3e-44e61672f0e2" (UID: "dae18372-f73e-4482-ac3e-44e61672f0e2"). InnerVolumeSpecName "kube-api-access-jmk28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:52:10.495301 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.495275 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dae18372-f73e-4482-ac3e-44e61672f0e2" (UID: "dae18372-f73e-4482-ac3e-44e61672f0e2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:52:10.495636 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.495618 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-token" (OuterVolumeSpecName: "istio-token") pod "dae18372-f73e-4482-ac3e-44e61672f0e2" (UID: "dae18372-f73e-4482-ac3e-44e61672f0e2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:52:10.495703 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.495652 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dae18372-f73e-4482-ac3e-44e61672f0e2" (UID: "dae18372-f73e-4482-ac3e-44e61672f0e2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 22:52:10.572008 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.571974 2578 generic.go:356] "Generic (PLEG): container finished" podID="dae18372-f73e-4482-ac3e-44e61672f0e2" containerID="e210645996009776ec3ac80a64ddf9d69e39d4aa95ca93ba8847376669271651" exitCode=0 Jul 16 22:52:10.572171 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.572013 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" event={"ID":"dae18372-f73e-4482-ac3e-44e61672f0e2","Type":"ContainerDied","Data":"e210645996009776ec3ac80a64ddf9d69e39d4aa95ca93ba8847376669271651"} Jul 16 22:52:10.572171 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.572025 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" Jul 16 22:52:10.572171 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.572101 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz" event={"ID":"dae18372-f73e-4482-ac3e-44e61672f0e2","Type":"ContainerDied","Data":"3d1f227729f1bc4e1c3dc297271471829aa2c8d2e5b277a8aaba9f44382a3b4c"} Jul 16 22:52:10.572171 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.572124 2578 scope.go:117] "RemoveContainer" containerID="e210645996009776ec3ac80a64ddf9d69e39d4aa95ca93ba8847376669271651" Jul 16 22:52:10.581449 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.581432 2578 scope.go:117] "RemoveContainer" containerID="c34cc978d9a16aa77c8e3085f014445e0b6ac09cd099a2dccd130f117eddb432" Jul 16 22:52:10.589322 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.589308 2578 scope.go:117] "RemoveContainer" containerID="e210645996009776ec3ac80a64ddf9d69e39d4aa95ca93ba8847376669271651" Jul 16 22:52:10.589601 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:52:10.589584 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e210645996009776ec3ac80a64ddf9d69e39d4aa95ca93ba8847376669271651\": container with ID starting with e210645996009776ec3ac80a64ddf9d69e39d4aa95ca93ba8847376669271651 not found: ID does not exist" containerID="e210645996009776ec3ac80a64ddf9d69e39d4aa95ca93ba8847376669271651" Jul 16 22:52:10.589648 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.589610 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e210645996009776ec3ac80a64ddf9d69e39d4aa95ca93ba8847376669271651"} err="failed to get container status \"e210645996009776ec3ac80a64ddf9d69e39d4aa95ca93ba8847376669271651\": rpc error: code = NotFound desc = could not find container \"e210645996009776ec3ac80a64ddf9d69e39d4aa95ca93ba8847376669271651\": container with ID starting with e210645996009776ec3ac80a64ddf9d69e39d4aa95ca93ba8847376669271651 not found: ID does not exist" Jul 16 22:52:10.589648 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.589628 2578 scope.go:117] "RemoveContainer" containerID="c34cc978d9a16aa77c8e3085f014445e0b6ac09cd099a2dccd130f117eddb432" Jul 16 22:52:10.589880 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:52:10.589861 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c34cc978d9a16aa77c8e3085f014445e0b6ac09cd099a2dccd130f117eddb432\": container with ID starting with c34cc978d9a16aa77c8e3085f014445e0b6ac09cd099a2dccd130f117eddb432 not found: ID does not exist" containerID="c34cc978d9a16aa77c8e3085f014445e0b6ac09cd099a2dccd130f117eddb432" Jul 16 22:52:10.589935 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.589889 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c34cc978d9a16aa77c8e3085f014445e0b6ac09cd099a2dccd130f117eddb432"} err="failed to get container status \"c34cc978d9a16aa77c8e3085f014445e0b6ac09cd099a2dccd130f117eddb432\": rpc error: code = NotFound desc = could not find container \"c34cc978d9a16aa77c8e3085f014445e0b6ac09cd099a2dccd130f117eddb432\": container with ID starting with c34cc978d9a16aa77c8e3085f014445e0b6ac09cd099a2dccd130f117eddb432 not found: ID does not exist" Jul 16 22:52:10.594377 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.594359 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmk28\" (UniqueName: \"kubernetes.io/projected/dae18372-f73e-4482-ac3e-44e61672f0e2-kube-api-access-jmk28\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:52:10.594435 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.594380 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-data\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:52:10.594435 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.594388 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-envoy\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:52:10.594435 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.594397 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-podinfo\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:52:10.594435 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.594406 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dae18372-f73e-4482-ac3e-44e61672f0e2-istio-token\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:52:10.594435 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.594415 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae18372-f73e-4482-ac3e-44e61672f0e2-workload-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:52:10.598015 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.597992 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz"] Jul 16 22:52:10.606006 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:10.605983 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8a492916-openshift-default-5df89bdfbc-rxsnz"] Jul 16 22:52:12.431598 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:52:12.431562 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dae18372-f73e-4482-ac3e-44e61672f0e2" path="/var/lib/kubelet/pods/dae18372-f73e-4482-ac3e-44e61672f0e2/volumes" Jul 16 22:53:02.171665 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.171630 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9"] Jul 16 22:53:02.172066 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.172004 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dae18372-f73e-4482-ac3e-44e61672f0e2" containerName="istio-proxy" Jul 16 22:53:02.172066 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.172015 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dae18372-f73e-4482-ac3e-44e61672f0e2" containerName="istio-proxy" Jul 16 22:53:02.172066 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.172037 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dae18372-f73e-4482-ac3e-44e61672f0e2" containerName="istio-proxy" Jul 16 22:53:02.172066 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.172043 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dae18372-f73e-4482-ac3e-44e61672f0e2" containerName="istio-proxy" Jul 16 22:53:02.172261 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.172126 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dae18372-f73e-4482-ac3e-44e61672f0e2" containerName="istio-proxy" Jul 16 22:53:02.172261 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.172136 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dae18372-f73e-4482-ac3e-44e61672f0e2" containerName="istio-proxy" Jul 16 22:53:02.175081 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.175053 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.181510 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.181474 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-acf29b-openshift-default-dockercfg-gstdj\"" Jul 16 22:53:02.188502 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.188479 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9"] Jul 16 22:53:02.188917 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.188888 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-workload-socket\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.189034 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.188921 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-credential-socket\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.189034 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.189003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-workload-certs\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.189185 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.189040 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-istio-data\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.189185 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.189161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9864f242-41ca-479e-bcfe-ed52424c881a-istiod-ca-cert\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.189274 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.189200 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-istio-envoy\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.189274 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.189254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8m6p\" (UniqueName: \"kubernetes.io/projected/9864f242-41ca-479e-bcfe-ed52424c881a-kube-api-access-p8m6p\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.189358 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.189322 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9864f242-41ca-479e-bcfe-ed52424c881a-istio-token\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.189411 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.189357 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9864f242-41ca-479e-bcfe-ed52424c881a-istio-podinfo\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.289805 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.289765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9864f242-41ca-479e-bcfe-ed52424c881a-istio-token\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.289805 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.289810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9864f242-41ca-479e-bcfe-ed52424c881a-istio-podinfo\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.290013 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.289843 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-workload-socket\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.290059 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.290004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-credential-socket\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.290142 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.290063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-workload-certs\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.290142 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.290111 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-istio-data\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.290254 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.290169 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9864f242-41ca-479e-bcfe-ed52424c881a-istiod-ca-cert\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.290254 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.290195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-istio-envoy\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.290254 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.290236 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8m6p\" (UniqueName: \"kubernetes.io/projected/9864f242-41ca-479e-bcfe-ed52424c881a-kube-api-access-p8m6p\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.290430 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.290272 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-workload-socket\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.290489 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.290430 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-credential-socket\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.290489 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.290460 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-istio-data\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.290580 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.290564 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-workload-certs\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.290926 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.290903 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9864f242-41ca-479e-bcfe-ed52424c881a-istiod-ca-cert\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.292304 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.292281 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-istio-envoy\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.292413 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.292393 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9864f242-41ca-479e-bcfe-ed52424c881a-istio-podinfo\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.298508 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.298484 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9864f242-41ca-479e-bcfe-ed52424c881a-istio-token\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.298718 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.298698 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8m6p\" (UniqueName: \"kubernetes.io/projected/9864f242-41ca-479e-bcfe-ed52424c881a-kube-api-access-p8m6p\") pod \"e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.485420 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.485388 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:02.632770 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.632741 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9"] Jul 16 22:53:02.634433 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:53:02.634404 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9864f242_41ca_479e_bcfe_ed52424c881a.slice/crio-8f88a54fe2aa76942fdb0453c0e94ec22416b63a7a7286076d5f0d5b1c6e03df WatchSource:0}: Error finding container 8f88a54fe2aa76942fdb0453c0e94ec22416b63a7a7286076d5f0d5b1c6e03df: Status 404 returned error can't find the container with id 8f88a54fe2aa76942fdb0453c0e94ec22416b63a7a7286076d5f0d5b1c6e03df Jul 16 22:53:02.636707 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.636669 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:53:02.636789 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.636738 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:53:02.636789 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.636770 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:53:02.835177 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.835080 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" event={"ID":"9864f242-41ca-479e-bcfe-ed52424c881a","Type":"ContainerStarted","Data":"e5b6f15231ad64f5ccabca2fcba67eaa8317d7d9e94a491598ad6295a3ce8ce8"} Jul 16 22:53:02.835177 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.835145 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" event={"ID":"9864f242-41ca-479e-bcfe-ed52424c881a","Type":"ContainerStarted","Data":"8f88a54fe2aa76942fdb0453c0e94ec22416b63a7a7286076d5f0d5b1c6e03df"} Jul 16 22:53:02.859277 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:02.859221 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" podStartSLOduration=0.859204886 podStartE2EDuration="859.204886ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:53:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:53:02.856427227 +0000 UTC m=+2348.959072454" watchObservedRunningTime="2026-07-16 22:53:02.859204886 +0000 UTC m=+2348.961850112" Jul 16 22:53:03.486493 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:03.486457 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:03.491704 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:03.491679 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:03.840278 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:03.840195 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:03.841029 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:03.841009 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:10.012938 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.012906 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw"] Jul 16 22:53:10.016694 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.016672 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.020054 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.020031 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-db89db-openshift-default-dockercfg-2hsrf\"" Jul 16 22:53:10.029340 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.029315 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw"] Jul 16 22:53:10.065872 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.065847 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-istio-envoy\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.065981 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.065880 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-istio-data\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.065981 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.065903 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c69383de-a011-4002-8d4e-065d3879526a-istiod-ca-cert\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.066110 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.066008 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-workload-socket\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.066185 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.066122 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-workload-certs\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.066185 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.066157 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c69383de-a011-4002-8d4e-065d3879526a-istio-podinfo\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.066256 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.066245 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-credential-socket\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.066291 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.066276 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmhgg\" (UniqueName: \"kubernetes.io/projected/c69383de-a011-4002-8d4e-065d3879526a-kube-api-access-qmhgg\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.066365 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.066332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c69383de-a011-4002-8d4e-065d3879526a-istio-token\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.167330 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.167284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-workload-socket\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.167530 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.167385 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-workload-certs\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.167530 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.167414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c69383de-a011-4002-8d4e-065d3879526a-istio-podinfo\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.167530 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.167479 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-credential-socket\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.167530 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.167523 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmhgg\" (UniqueName: \"kubernetes.io/projected/c69383de-a011-4002-8d4e-065d3879526a-kube-api-access-qmhgg\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.167753 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.167581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c69383de-a011-4002-8d4e-065d3879526a-istio-token\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.167753 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.167611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-istio-envoy\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.167859 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.167796 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-workload-socket\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.167859 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.167815 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-workload-certs\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.167969 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.167863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-istio-data\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.167969 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.167913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c69383de-a011-4002-8d4e-065d3879526a-istiod-ca-cert\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.167969 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.167861 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-credential-socket\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.168153 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.168135 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-istio-data\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.168477 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.168460 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c69383de-a011-4002-8d4e-065d3879526a-istiod-ca-cert\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.169849 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.169816 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-istio-envoy\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.170216 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.170199 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c69383de-a011-4002-8d4e-065d3879526a-istio-podinfo\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.176004 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.175980 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c69383de-a011-4002-8d4e-065d3879526a-istio-token\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.176394 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.176376 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmhgg\" (UniqueName: \"kubernetes.io/projected/c69383de-a011-4002-8d4e-065d3879526a-kube-api-access-qmhgg\") pod \"e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.327378 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.327290 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:10.478515 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.478488 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw"] Jul 16 22:53:10.480202 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:53:10.480165 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69383de_a011_4002_8d4e_065d3879526a.slice/crio-bad92f357538862f4f6ea84931af99d2625b61f94d9f972d451bff613b65741b WatchSource:0}: Error finding container bad92f357538862f4f6ea84931af99d2625b61f94d9f972d451bff613b65741b: Status 404 returned error can't find the container with id bad92f357538862f4f6ea84931af99d2625b61f94d9f972d451bff613b65741b Jul 16 22:53:10.482367 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.482330 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:53:10.482436 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.482406 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:53:10.482471 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.482438 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:53:10.874198 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.874157 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" event={"ID":"c69383de-a011-4002-8d4e-065d3879526a","Type":"ContainerStarted","Data":"b2dca562b5cf1cc10d55200a435cb7e921afb7457573b5a0f677219e4e7b0620"} Jul 16 22:53:10.874378 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.874222 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" event={"ID":"c69383de-a011-4002-8d4e-065d3879526a","Type":"ContainerStarted","Data":"bad92f357538862f4f6ea84931af99d2625b61f94d9f972d451bff613b65741b"} Jul 16 22:53:10.895562 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:10.895504 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" podStartSLOduration=1.8954883329999999 podStartE2EDuration="1.895488333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:53:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:53:10.894112308 +0000 UTC m=+2356.996757556" watchObservedRunningTime="2026-07-16 22:53:10.895488333 +0000 UTC m=+2356.998133558" Jul 16 22:53:11.328419 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:11.328386 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:11.333601 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:11.333575 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:11.882343 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:11.882303 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:11.883635 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:11.883603 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:18.871440 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:18.870548 2578 patch_prober.go:28] interesting pod/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": read tcp 10.134.0.2:43656->10.134.0.43:15021: read: connection reset by peer" start-of-body= Jul 16 22:53:18.871440 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:18.870626 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" podUID="9864f242-41ca-479e-bcfe-ed52424c881a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": read tcp 10.134.0.2:43656->10.134.0.43:15021: read: connection reset by peer" Jul 16 22:53:18.918641 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:18.918606 2578 generic.go:356] "Generic (PLEG): container finished" podID="9864f242-41ca-479e-bcfe-ed52424c881a" containerID="e5b6f15231ad64f5ccabca2fcba67eaa8317d7d9e94a491598ad6295a3ce8ce8" exitCode=0 Jul 16 22:53:18.918790 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:18.918683 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" event={"ID":"9864f242-41ca-479e-bcfe-ed52424c881a","Type":"ContainerDied","Data":"e5b6f15231ad64f5ccabca2fcba67eaa8317d7d9e94a491598ad6295a3ce8ce8"} Jul 16 22:53:18.919168 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:18.919154 2578 scope.go:117] "RemoveContainer" containerID="e5b6f15231ad64f5ccabca2fcba67eaa8317d7d9e94a491598ad6295a3ce8ce8" Jul 16 22:53:18.920166 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:18.920135 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:53:18.920280 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:18.920210 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:53:18.920280 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:18.920251 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:53:19.930415 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:19.930372 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" event={"ID":"9864f242-41ca-479e-bcfe-ed52424c881a","Type":"ContainerStarted","Data":"b6911ec1136c60a087d02e5106c3ee0e41bff019a69460c7e96418374439025c"} Jul 16 22:53:20.486544 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:20.486514 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:20.486718 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:20.486700 2578 patch_prober.go:28] interesting pod/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 16 22:53:20.486764 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:20.486746 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" podUID="9864f242-41ca-479e-bcfe-ed52424c881a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 16 22:53:21.486251 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:21.486209 2578 patch_prober.go:28] interesting pod/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 16 22:53:21.486685 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:21.486277 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" podUID="9864f242-41ca-479e-bcfe-ed52424c881a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 16 22:53:22.486775 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:22.486742 2578 patch_prober.go:28] interesting pod/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 16 22:53:22.487310 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:22.487044 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" podUID="9864f242-41ca-479e-bcfe-ed52424c881a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 16 22:53:23.486344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:23.486301 2578 patch_prober.go:28] interesting pod/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 16 22:53:23.486532 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:23.486366 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" podUID="9864f242-41ca-479e-bcfe-ed52424c881a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 16 22:53:24.489844 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:24.489810 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:24.490365 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:24.490216 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:24.490803 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:24.490786 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:53:27.707708 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:27.707391 2578 patch_prober.go:28] interesting pod/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": read tcp 10.134.0.2:38272->10.134.0.44:15021: read: connection reset by peer" start-of-body= Jul 16 22:53:27.707708 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:27.707456 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" podUID="c69383de-a011-4002-8d4e-065d3879526a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": read tcp 10.134.0.2:38272->10.134.0.44:15021: read: connection reset by peer" Jul 16 22:53:27.980635 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:27.980551 2578 generic.go:356] "Generic (PLEG): container finished" podID="c69383de-a011-4002-8d4e-065d3879526a" containerID="b2dca562b5cf1cc10d55200a435cb7e921afb7457573b5a0f677219e4e7b0620" exitCode=0 Jul 16 22:53:27.980789 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:27.980630 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" event={"ID":"c69383de-a011-4002-8d4e-065d3879526a","Type":"ContainerDied","Data":"b2dca562b5cf1cc10d55200a435cb7e921afb7457573b5a0f677219e4e7b0620"} Jul 16 22:53:27.981066 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:27.981052 2578 scope.go:117] "RemoveContainer" containerID="b2dca562b5cf1cc10d55200a435cb7e921afb7457573b5a0f677219e4e7b0620" Jul 16 22:53:27.982122 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:27.982096 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:53:27.982184 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:27.982172 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:53:27.982220 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:27.982211 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:53:28.987823 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:28.987787 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" event={"ID":"c69383de-a011-4002-8d4e-065d3879526a","Type":"ContainerStarted","Data":"9db74b04ad5baaa02366369eb90e33c63676d7de6e78b3ea63a503f3792a2d9a"} Jul 16 22:53:29.328214 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:29.328120 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:29.328365 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:29.328342 2578 patch_prober.go:28] interesting pod/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 16 22:53:29.328418 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:29.328398 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" podUID="c69383de-a011-4002-8d4e-065d3879526a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 16 22:53:30.328724 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:30.328670 2578 patch_prober.go:28] interesting pod/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 16 22:53:30.329437 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:30.329362 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" podUID="c69383de-a011-4002-8d4e-065d3879526a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 16 22:53:31.327859 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:31.327816 2578 patch_prober.go:28] interesting pod/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 16 22:53:31.328216 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:31.328184 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" podUID="c69383de-a011-4002-8d4e-065d3879526a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 16 22:53:32.328147 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:32.328101 2578 patch_prober.go:28] interesting pod/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 16 22:53:32.328639 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:32.328170 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" podUID="c69383de-a011-4002-8d4e-065d3879526a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 16 22:53:33.328399 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:33.328359 2578 patch_prober.go:28] interesting pod/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 16 22:53:33.329013 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:33.328975 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" podUID="c69383de-a011-4002-8d4e-065d3879526a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 16 22:53:34.331637 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:34.331600 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:34.332088 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:34.331874 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:34.332603 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:34.332583 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:53:58.861030 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:58.860997 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:53:58.873860 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:53:58.873838 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:54:34.155878 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:34.155832 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9"] Jul 16 22:54:34.156489 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:34.156090 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" podUID="9864f242-41ca-479e-bcfe-ed52424c881a" containerName="istio-proxy" containerID="cri-o://b6911ec1136c60a087d02e5106c3ee0e41bff019a69460c7e96418374439025c" gracePeriod=30 Jul 16 22:54:39.360166 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.360135 2578 generic.go:356] "Generic (PLEG): container finished" podID="9864f242-41ca-479e-bcfe-ed52424c881a" containerID="b6911ec1136c60a087d02e5106c3ee0e41bff019a69460c7e96418374439025c" exitCode=0 Jul 16 22:54:39.360563 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.360208 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" event={"ID":"9864f242-41ca-479e-bcfe-ed52424c881a","Type":"ContainerDied","Data":"b6911ec1136c60a087d02e5106c3ee0e41bff019a69460c7e96418374439025c"} Jul 16 22:54:39.360563 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.360271 2578 scope.go:117] "RemoveContainer" containerID="e5b6f15231ad64f5ccabca2fcba67eaa8317d7d9e94a491598ad6295a3ce8ce8" Jul 16 22:54:39.416318 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.416292 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:54:39.560057 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.560023 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8m6p\" (UniqueName: \"kubernetes.io/projected/9864f242-41ca-479e-bcfe-ed52424c881a-kube-api-access-p8m6p\") pod \"9864f242-41ca-479e-bcfe-ed52424c881a\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " Jul 16 22:54:39.560291 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.560109 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9864f242-41ca-479e-bcfe-ed52424c881a-istio-token\") pod \"9864f242-41ca-479e-bcfe-ed52424c881a\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " Jul 16 22:54:39.560291 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.560152 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-istio-envoy\") pod \"9864f242-41ca-479e-bcfe-ed52424c881a\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " Jul 16 22:54:39.560291 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.560180 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-istio-data\") pod \"9864f242-41ca-479e-bcfe-ed52424c881a\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " Jul 16 22:54:39.560474 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.560322 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-workload-certs\") pod \"9864f242-41ca-479e-bcfe-ed52424c881a\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " Jul 16 22:54:39.560474 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.560385 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-credential-socket\") pod \"9864f242-41ca-479e-bcfe-ed52424c881a\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " Jul 16 22:54:39.560474 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.560429 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9864f242-41ca-479e-bcfe-ed52424c881a-istio-podinfo\") pod \"9864f242-41ca-479e-bcfe-ed52424c881a\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " Jul 16 22:54:39.560627 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.560479 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-workload-socket\") pod \"9864f242-41ca-479e-bcfe-ed52424c881a\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " Jul 16 22:54:39.560627 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.560558 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9864f242-41ca-479e-bcfe-ed52424c881a-istiod-ca-cert\") pod \"9864f242-41ca-479e-bcfe-ed52424c881a\" (UID: \"9864f242-41ca-479e-bcfe-ed52424c881a\") " Jul 16 22:54:39.560729 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.560627 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9864f242-41ca-479e-bcfe-ed52424c881a" (UID: "9864f242-41ca-479e-bcfe-ed52424c881a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:54:39.560835 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.560807 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9864f242-41ca-479e-bcfe-ed52424c881a" (UID: "9864f242-41ca-479e-bcfe-ed52424c881a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:54:39.560891 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.560825 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9864f242-41ca-479e-bcfe-ed52424c881a" (UID: "9864f242-41ca-479e-bcfe-ed52424c881a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:54:39.561047 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.561013 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9864f242-41ca-479e-bcfe-ed52424c881a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9864f242-41ca-479e-bcfe-ed52424c881a" (UID: "9864f242-41ca-479e-bcfe-ed52424c881a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:54:39.561208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.561169 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-workload-certs\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:54:39.561208 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.561192 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-credential-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:54:39.561328 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.561207 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-workload-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:54:39.561328 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.561221 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9864f242-41ca-479e-bcfe-ed52424c881a-istiod-ca-cert\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:54:39.561328 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.561168 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-istio-data" (OuterVolumeSpecName: "istio-data") pod "9864f242-41ca-479e-bcfe-ed52424c881a" (UID: "9864f242-41ca-479e-bcfe-ed52424c881a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:54:39.562420 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.562395 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9864f242-41ca-479e-bcfe-ed52424c881a" (UID: "9864f242-41ca-479e-bcfe-ed52424c881a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:54:39.562759 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.562731 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9864f242-41ca-479e-bcfe-ed52424c881a-kube-api-access-p8m6p" (OuterVolumeSpecName: "kube-api-access-p8m6p") pod "9864f242-41ca-479e-bcfe-ed52424c881a" (UID: "9864f242-41ca-479e-bcfe-ed52424c881a"). InnerVolumeSpecName "kube-api-access-p8m6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:54:39.562759 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.562738 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9864f242-41ca-479e-bcfe-ed52424c881a-istio-token" (OuterVolumeSpecName: "istio-token") pod "9864f242-41ca-479e-bcfe-ed52424c881a" (UID: "9864f242-41ca-479e-bcfe-ed52424c881a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:54:39.562959 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.562932 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9864f242-41ca-479e-bcfe-ed52424c881a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9864f242-41ca-479e-bcfe-ed52424c881a" (UID: "9864f242-41ca-479e-bcfe-ed52424c881a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 22:54:39.661709 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.661680 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9864f242-41ca-479e-bcfe-ed52424c881a-istio-podinfo\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:54:39.661709 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.661705 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8m6p\" (UniqueName: \"kubernetes.io/projected/9864f242-41ca-479e-bcfe-ed52424c881a-kube-api-access-p8m6p\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:54:39.661858 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.661716 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9864f242-41ca-479e-bcfe-ed52424c881a-istio-token\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:54:39.661858 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.661726 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-istio-envoy\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:54:39.661858 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:39.661734 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9864f242-41ca-479e-bcfe-ed52424c881a-istio-data\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:54:40.367099 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:40.367040 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" event={"ID":"9864f242-41ca-479e-bcfe-ed52424c881a","Type":"ContainerDied","Data":"8f88a54fe2aa76942fdb0453c0e94ec22416b63a7a7286076d5f0d5b1c6e03df"} Jul 16 22:54:40.367099 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:40.367090 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9" Jul 16 22:54:40.367606 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:40.367130 2578 scope.go:117] "RemoveContainer" containerID="b6911ec1136c60a087d02e5106c3ee0e41bff019a69460c7e96418374439025c" Jul 16 22:54:40.392547 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:40.392519 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9"] Jul 16 22:54:40.397298 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:40.397274 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-acf29b-openshift-default-56457b79bc-8jlr9"] Jul 16 22:54:40.431779 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:40.431744 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9864f242-41ca-479e-bcfe-ed52424c881a" path="/var/lib/kubelet/pods/9864f242-41ca-479e-bcfe-ed52424c881a/volumes" Jul 16 22:54:56.191473 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:56.191438 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw"] Jul 16 22:54:56.191916 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:56.191662 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" podUID="c69383de-a011-4002-8d4e-065d3879526a" containerName="istio-proxy" containerID="cri-o://9db74b04ad5baaa02366369eb90e33c63676d7de6e78b3ea63a503f3792a2d9a" gracePeriod=30 Jul 16 22:54:57.172380 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.172346 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v"] Jul 16 22:54:57.172753 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.172740 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9864f242-41ca-479e-bcfe-ed52424c881a" containerName="istio-proxy" Jul 16 22:54:57.172800 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.172753 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9864f242-41ca-479e-bcfe-ed52424c881a" containerName="istio-proxy" Jul 16 22:54:57.172800 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.172777 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9864f242-41ca-479e-bcfe-ed52424c881a" containerName="istio-proxy" Jul 16 22:54:57.172800 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.172782 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9864f242-41ca-479e-bcfe-ed52424c881a" containerName="istio-proxy" Jul 16 22:54:57.172911 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.172838 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9864f242-41ca-479e-bcfe-ed52424c881a" containerName="istio-proxy" Jul 16 22:54:57.177669 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.177648 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.180409 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.180382 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-ddb113-openshift-default-dockercfg-gn95q\"" Jul 16 22:54:57.191275 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.191249 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v"] Jul 16 22:54:57.233369 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.233328 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37518409-94ba-4a4e-a262-523fb3f98464-istiod-ca-cert\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.233831 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.233372 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-istio-envoy\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.233831 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.233478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-istio-data\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.233831 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.233524 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkq5s\" (UniqueName: \"kubernetes.io/projected/37518409-94ba-4a4e-a262-523fb3f98464-kube-api-access-rkq5s\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.233831 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.233557 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-credential-socket\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.233831 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.233573 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-workload-certs\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.233831 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.233613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37518409-94ba-4a4e-a262-523fb3f98464-istio-token\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.233831 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.233650 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37518409-94ba-4a4e-a262-523fb3f98464-istio-podinfo\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.233831 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.233687 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-workload-socket\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.334842 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.334797 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37518409-94ba-4a4e-a262-523fb3f98464-istiod-ca-cert\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.334842 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.334845 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-istio-envoy\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.335150 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.334884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-istio-data\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.335150 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.334917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkq5s\" (UniqueName: \"kubernetes.io/projected/37518409-94ba-4a4e-a262-523fb3f98464-kube-api-access-rkq5s\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.335150 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.335106 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-credential-socket\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.335321 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.335156 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-workload-certs\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.335321 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.335191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37518409-94ba-4a4e-a262-523fb3f98464-istio-token\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.335321 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.335233 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37518409-94ba-4a4e-a262-523fb3f98464-istio-podinfo\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.335321 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.335278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-workload-socket\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.335513 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.335425 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-istio-data\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.335570 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.335541 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-credential-socket\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.335608 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.335565 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-workload-certs\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.335643 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.335625 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-workload-socket\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.335711 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.335694 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37518409-94ba-4a4e-a262-523fb3f98464-istiod-ca-cert\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.337227 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.337208 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-istio-envoy\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.337740 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.337724 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37518409-94ba-4a4e-a262-523fb3f98464-istio-podinfo\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.344769 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.344739 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37518409-94ba-4a4e-a262-523fb3f98464-istio-token\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.344898 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.344828 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkq5s\" (UniqueName: \"kubernetes.io/projected/37518409-94ba-4a4e-a262-523fb3f98464-kube-api-access-rkq5s\") pod \"e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.488795 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.488737 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:57.633697 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.633670 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v"] Jul 16 22:54:57.636654 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:54:57.636625 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37518409_94ba_4a4e_a262_523fb3f98464.slice/crio-75b53b910ccf53d22b3c2d488f661eac46d20f4eaea563f500d1726168386f33 WatchSource:0}: Error finding container 75b53b910ccf53d22b3c2d488f661eac46d20f4eaea563f500d1726168386f33: Status 404 returned error can't find the container with id 75b53b910ccf53d22b3c2d488f661eac46d20f4eaea563f500d1726168386f33 Jul 16 22:54:57.639210 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.639178 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:54:57.639315 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.639258 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:54:57.639315 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:57.639304 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:54:58.470668 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:58.470632 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" event={"ID":"37518409-94ba-4a4e-a262-523fb3f98464","Type":"ContainerStarted","Data":"aa12e2c8c4b9b4f323c9565c65a19ef238674553574f5c4b55ae40e7bd9e10bc"} Jul 16 22:54:58.471094 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:58.470688 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" event={"ID":"37518409-94ba-4a4e-a262-523fb3f98464","Type":"ContainerStarted","Data":"75b53b910ccf53d22b3c2d488f661eac46d20f4eaea563f500d1726168386f33"} Jul 16 22:54:58.489376 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:58.489350 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:58.494434 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:58.494397 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:58.494766 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:58.494702 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" podStartSLOduration=1.494685385 podStartE2EDuration="1.494685385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:54:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:54:58.494053403 +0000 UTC m=+2464.596698630" watchObservedRunningTime="2026-07-16 22:54:58.494685385 +0000 UTC m=+2464.597330612" Jul 16 22:54:59.475940 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:59.475910 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:54:59.476926 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:54:59.476908 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:55:01.465664 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.465279 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:55:01.489146 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.489100 2578 generic.go:356] "Generic (PLEG): container finished" podID="c69383de-a011-4002-8d4e-065d3879526a" containerID="9db74b04ad5baaa02366369eb90e33c63676d7de6e78b3ea63a503f3792a2d9a" exitCode=0 Jul 16 22:55:01.489443 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.489414 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" event={"ID":"c69383de-a011-4002-8d4e-065d3879526a","Type":"ContainerDied","Data":"9db74b04ad5baaa02366369eb90e33c63676d7de6e78b3ea63a503f3792a2d9a"} Jul 16 22:55:01.489565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.489488 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" Jul 16 22:55:01.489565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.489501 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw" event={"ID":"c69383de-a011-4002-8d4e-065d3879526a","Type":"ContainerDied","Data":"bad92f357538862f4f6ea84931af99d2625b61f94d9f972d451bff613b65741b"} Jul 16 22:55:01.489565 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.489534 2578 scope.go:117] "RemoveContainer" containerID="9db74b04ad5baaa02366369eb90e33c63676d7de6e78b3ea63a503f3792a2d9a" Jul 16 22:55:01.499083 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.499048 2578 scope.go:117] "RemoveContainer" containerID="b2dca562b5cf1cc10d55200a435cb7e921afb7457573b5a0f677219e4e7b0620" Jul 16 22:55:01.507145 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.507127 2578 scope.go:117] "RemoveContainer" containerID="9db74b04ad5baaa02366369eb90e33c63676d7de6e78b3ea63a503f3792a2d9a" Jul 16 22:55:01.507370 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:55:01.507347 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9db74b04ad5baaa02366369eb90e33c63676d7de6e78b3ea63a503f3792a2d9a\": container with ID starting with 9db74b04ad5baaa02366369eb90e33c63676d7de6e78b3ea63a503f3792a2d9a not found: ID does not exist" containerID="9db74b04ad5baaa02366369eb90e33c63676d7de6e78b3ea63a503f3792a2d9a" Jul 16 22:55:01.507455 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.507380 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9db74b04ad5baaa02366369eb90e33c63676d7de6e78b3ea63a503f3792a2d9a"} err="failed to get container status \"9db74b04ad5baaa02366369eb90e33c63676d7de6e78b3ea63a503f3792a2d9a\": rpc error: code = NotFound desc = could not find container \"9db74b04ad5baaa02366369eb90e33c63676d7de6e78b3ea63a503f3792a2d9a\": container with ID starting with 9db74b04ad5baaa02366369eb90e33c63676d7de6e78b3ea63a503f3792a2d9a not found: ID does not exist" Jul 16 22:55:01.507455 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.507404 2578 scope.go:117] "RemoveContainer" containerID="b2dca562b5cf1cc10d55200a435cb7e921afb7457573b5a0f677219e4e7b0620" Jul 16 22:55:01.507635 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:55:01.507621 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2dca562b5cf1cc10d55200a435cb7e921afb7457573b5a0f677219e4e7b0620\": container with ID starting with b2dca562b5cf1cc10d55200a435cb7e921afb7457573b5a0f677219e4e7b0620 not found: ID does not exist" containerID="b2dca562b5cf1cc10d55200a435cb7e921afb7457573b5a0f677219e4e7b0620" Jul 16 22:55:01.507698 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.507638 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2dca562b5cf1cc10d55200a435cb7e921afb7457573b5a0f677219e4e7b0620"} err="failed to get container status \"b2dca562b5cf1cc10d55200a435cb7e921afb7457573b5a0f677219e4e7b0620\": rpc error: code = NotFound desc = could not find container \"b2dca562b5cf1cc10d55200a435cb7e921afb7457573b5a0f677219e4e7b0620\": container with ID starting with b2dca562b5cf1cc10d55200a435cb7e921afb7457573b5a0f677219e4e7b0620 not found: ID does not exist" Jul 16 22:55:01.577968 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.577933 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmhgg\" (UniqueName: \"kubernetes.io/projected/c69383de-a011-4002-8d4e-065d3879526a-kube-api-access-qmhgg\") pod \"c69383de-a011-4002-8d4e-065d3879526a\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " Jul 16 22:55:01.578132 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.577992 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-istio-data\") pod \"c69383de-a011-4002-8d4e-065d3879526a\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " Jul 16 22:55:01.578132 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.578018 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-workload-socket\") pod \"c69383de-a011-4002-8d4e-065d3879526a\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " Jul 16 22:55:01.578132 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.578065 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-credential-socket\") pod \"c69383de-a011-4002-8d4e-065d3879526a\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " Jul 16 22:55:01.578315 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.578160 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-istio-envoy\") pod \"c69383de-a011-4002-8d4e-065d3879526a\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " Jul 16 22:55:01.578315 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.578208 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c69383de-a011-4002-8d4e-065d3879526a-istiod-ca-cert\") pod \"c69383de-a011-4002-8d4e-065d3879526a\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " Jul 16 22:55:01.578315 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.578248 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c69383de-a011-4002-8d4e-065d3879526a-istio-podinfo\") pod \"c69383de-a011-4002-8d4e-065d3879526a\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " Jul 16 22:55:01.578478 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.578383 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c69383de-a011-4002-8d4e-065d3879526a" (UID: "c69383de-a011-4002-8d4e-065d3879526a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:55:01.578478 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.578419 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c69383de-a011-4002-8d4e-065d3879526a" (UID: "c69383de-a011-4002-8d4e-065d3879526a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:55:01.578478 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.578438 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c69383de-a011-4002-8d4e-065d3879526a-istio-token\") pod \"c69383de-a011-4002-8d4e-065d3879526a\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " Jul 16 22:55:01.578624 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.578504 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-workload-certs\") pod \"c69383de-a011-4002-8d4e-065d3879526a\" (UID: \"c69383de-a011-4002-8d4e-065d3879526a\") " Jul 16 22:55:01.578673 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.578640 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c69383de-a011-4002-8d4e-065d3879526a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c69383de-a011-4002-8d4e-065d3879526a" (UID: "c69383de-a011-4002-8d4e-065d3879526a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:55:01.578938 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.578918 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-credential-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:55:01.579016 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.578943 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c69383de-a011-4002-8d4e-065d3879526a-istiod-ca-cert\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:55:01.579016 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.578934 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c69383de-a011-4002-8d4e-065d3879526a" (UID: "c69383de-a011-4002-8d4e-065d3879526a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:55:01.579016 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.578956 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-workload-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:55:01.579205 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.579013 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-istio-data" (OuterVolumeSpecName: "istio-data") pod "c69383de-a011-4002-8d4e-065d3879526a" (UID: "c69383de-a011-4002-8d4e-065d3879526a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:55:01.580456 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.580426 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c69383de-a011-4002-8d4e-065d3879526a" (UID: "c69383de-a011-4002-8d4e-065d3879526a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:55:01.580566 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.580519 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c69383de-a011-4002-8d4e-065d3879526a-istio-token" (OuterVolumeSpecName: "istio-token") pod "c69383de-a011-4002-8d4e-065d3879526a" (UID: "c69383de-a011-4002-8d4e-065d3879526a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:55:01.580705 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.580683 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c69383de-a011-4002-8d4e-065d3879526a-kube-api-access-qmhgg" (OuterVolumeSpecName: "kube-api-access-qmhgg") pod "c69383de-a011-4002-8d4e-065d3879526a" (UID: "c69383de-a011-4002-8d4e-065d3879526a"). InnerVolumeSpecName "kube-api-access-qmhgg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:55:01.580759 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.580745 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c69383de-a011-4002-8d4e-065d3879526a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c69383de-a011-4002-8d4e-065d3879526a" (UID: "c69383de-a011-4002-8d4e-065d3879526a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 22:55:01.679538 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.679500 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-istio-envoy\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:55:01.679538 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.679532 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c69383de-a011-4002-8d4e-065d3879526a-istio-podinfo\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:55:01.679538 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.679541 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c69383de-a011-4002-8d4e-065d3879526a-istio-token\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:55:01.679778 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.679550 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-workload-certs\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:55:01.679778 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.679562 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmhgg\" (UniqueName: \"kubernetes.io/projected/c69383de-a011-4002-8d4e-065d3879526a-kube-api-access-qmhgg\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:55:01.679778 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.679571 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c69383de-a011-4002-8d4e-065d3879526a-istio-data\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:55:01.818782 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.818742 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw"] Jul 16 22:55:01.825514 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:01.825484 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-db89db-openshift-default-675b846c65-q7wsw"] Jul 16 22:55:01.832973 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:55:01.832947 2578 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69383de_a011_4002_8d4e_065d3879526a.slice/crio-bad92f357538862f4f6ea84931af99d2625b61f94d9f972d451bff613b65741b\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69383de_a011_4002_8d4e_065d3879526a.slice\": RecentStats: unable to find data in memory cache]" Jul 16 22:55:02.432287 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:02.432252 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c69383de-a011-4002-8d4e-065d3879526a" path="/var/lib/kubelet/pods/c69383de-a011-4002-8d4e-065d3879526a/volumes" Jul 16 22:55:05.894377 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:05.894343 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st"] Jul 16 22:55:05.894789 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:05.894732 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c69383de-a011-4002-8d4e-065d3879526a" containerName="istio-proxy" Jul 16 22:55:05.894789 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:05.894745 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c69383de-a011-4002-8d4e-065d3879526a" containerName="istio-proxy" Jul 16 22:55:05.894869 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:05.894822 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9864f242-41ca-479e-bcfe-ed52424c881a" containerName="istio-proxy" Jul 16 22:55:05.894869 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:05.894830 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c69383de-a011-4002-8d4e-065d3879526a" containerName="istio-proxy" Jul 16 22:55:05.902260 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:05.902234 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:05.905316 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:05.905264 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-ef186c-openshift-default-dockercfg-67v49\"" Jul 16 22:55:05.922390 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:05.922363 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st"] Jul 16 22:55:06.019928 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.019888 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-data\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.020145 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.019959 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-envoy\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.020145 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.019989 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3693422a-5443-4d35-94f0-6d7ec3b19916-istiod-ca-cert\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.020145 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.020031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-workload-certs\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.020145 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.020062 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-976f4\" (UniqueName: \"kubernetes.io/projected/3693422a-5443-4d35-94f0-6d7ec3b19916-kube-api-access-976f4\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.020145 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.020108 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-credential-socket\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.020434 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.020162 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-token\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.020434 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.020207 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-podinfo\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.020434 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.020246 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-workload-socket\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.121686 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.121653 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-data\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.121893 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.121709 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-envoy\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.121893 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.121738 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3693422a-5443-4d35-94f0-6d7ec3b19916-istiod-ca-cert\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.121893 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.121772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-workload-certs\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.121893 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.121798 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-976f4\" (UniqueName: \"kubernetes.io/projected/3693422a-5443-4d35-94f0-6d7ec3b19916-kube-api-access-976f4\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.121893 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.121823 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-credential-socket\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.121893 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.121873 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-token\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.122289 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.121898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-podinfo\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.122289 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.121940 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-workload-socket\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.122289 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.122098 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-data\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.122289 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.122259 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-credential-socket\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.122476 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.122348 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-workload-socket\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.122476 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.122436 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-workload-certs\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.122543 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.122520 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3693422a-5443-4d35-94f0-6d7ec3b19916-istiod-ca-cert\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.123997 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.123975 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-envoy\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.124431 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.124413 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-podinfo\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.130879 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.130853 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-token\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.131203 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.131184 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-976f4\" (UniqueName: \"kubernetes.io/projected/3693422a-5443-4d35-94f0-6d7ec3b19916-kube-api-access-976f4\") pod \"e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.212364 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.212337 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:06.349149 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.349123 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st"] Jul 16 22:55:06.351241 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:55:06.351213 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3693422a_5443_4d35_94f0_6d7ec3b19916.slice/crio-ad2a09444ddb0d87d5c94041bacc14c394bf4d06617c3e8e1f725a838222ea2a WatchSource:0}: Error finding container ad2a09444ddb0d87d5c94041bacc14c394bf4d06617c3e8e1f725a838222ea2a: Status 404 returned error can't find the container with id ad2a09444ddb0d87d5c94041bacc14c394bf4d06617c3e8e1f725a838222ea2a Jul 16 22:55:06.353452 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.353420 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:55:06.353556 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.353481 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:55:06.353556 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.353509 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:55:06.518684 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.518595 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" event={"ID":"3693422a-5443-4d35-94f0-6d7ec3b19916","Type":"ContainerStarted","Data":"4554ffe3aeb6c840344fd618f68ac54a90d2618a5b76e1f308d94fead36a80e7"} Jul 16 22:55:06.518684 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.518668 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" event={"ID":"3693422a-5443-4d35-94f0-6d7ec3b19916","Type":"ContainerStarted","Data":"ad2a09444ddb0d87d5c94041bacc14c394bf4d06617c3e8e1f725a838222ea2a"} Jul 16 22:55:06.540338 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:06.540285 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" podStartSLOduration=1.540266275 podStartE2EDuration="1.540266275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:55:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:55:06.539282311 +0000 UTC m=+2472.641927530" watchObservedRunningTime="2026-07-16 22:55:06.540266275 +0000 UTC m=+2472.642911500" Jul 16 22:55:07.212824 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:07.212791 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:07.217712 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:07.217687 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:07.526722 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:07.526622 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:07.531576 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:07.531543 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:14.477452 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:14.477415 2578 patch_prober.go:28] interesting pod/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 16 22:55:14.477852 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:14.477477 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" podUID="37518409-94ba-4a4e-a262-523fb3f98464" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 16 22:55:14.568861 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:14.568829 2578 generic.go:356] "Generic (PLEG): container finished" podID="37518409-94ba-4a4e-a262-523fb3f98464" containerID="aa12e2c8c4b9b4f323c9565c65a19ef238674553574f5c4b55ae40e7bd9e10bc" exitCode=0 Jul 16 22:55:14.569042 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:14.568901 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" event={"ID":"37518409-94ba-4a4e-a262-523fb3f98464","Type":"ContainerDied","Data":"aa12e2c8c4b9b4f323c9565c65a19ef238674553574f5c4b55ae40e7bd9e10bc"} Jul 16 22:55:14.569382 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:14.569365 2578 scope.go:117] "RemoveContainer" containerID="aa12e2c8c4b9b4f323c9565c65a19ef238674553574f5c4b55ae40e7bd9e10bc" Jul 16 22:55:14.570412 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:14.570384 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:55:14.570478 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:14.570451 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:55:14.570513 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:14.570490 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:55:15.576427 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:15.576388 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" event={"ID":"37518409-94ba-4a4e-a262-523fb3f98464","Type":"ContainerStarted","Data":"0efcf490493f636f58a0983b570355e6488d8c75b9ba309e2a714efa07f793f6"} Jul 16 22:55:16.489551 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:16.489519 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:55:16.489728 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:16.489699 2578 patch_prober.go:28] interesting pod/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 16 22:55:16.489774 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:16.489745 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" podUID="37518409-94ba-4a4e-a262-523fb3f98464" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 16 22:55:17.489509 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:17.489473 2578 patch_prober.go:28] interesting pod/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 16 22:55:17.489896 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:17.489532 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" podUID="37518409-94ba-4a4e-a262-523fb3f98464" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 16 22:55:18.489975 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:18.489936 2578 patch_prober.go:28] interesting pod/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 16 22:55:18.490380 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:18.489991 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" podUID="37518409-94ba-4a4e-a262-523fb3f98464" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 16 22:55:19.489687 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:19.489650 2578 patch_prober.go:28] interesting pod/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 16 22:55:19.489871 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:19.489707 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" podUID="37518409-94ba-4a4e-a262-523fb3f98464" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 16 22:55:20.492720 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:20.492686 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:55:20.493121 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:20.493038 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:55:20.493821 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:20.493799 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:55:23.568266 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:23.568215 2578 patch_prober.go:28] interesting pod/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 16 22:55:23.568794 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:23.568279 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" podUID="3693422a-5443-4d35-94f0-6d7ec3b19916" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 16 22:55:25.631758 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:25.631723 2578 generic.go:356] "Generic (PLEG): container finished" podID="3693422a-5443-4d35-94f0-6d7ec3b19916" containerID="4554ffe3aeb6c840344fd618f68ac54a90d2618a5b76e1f308d94fead36a80e7" exitCode=0 Jul 16 22:55:25.632249 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:25.631796 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" event={"ID":"3693422a-5443-4d35-94f0-6d7ec3b19916","Type":"ContainerDied","Data":"4554ffe3aeb6c840344fd618f68ac54a90d2618a5b76e1f308d94fead36a80e7"} Jul 16 22:55:25.632297 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:25.632265 2578 scope.go:117] "RemoveContainer" containerID="4554ffe3aeb6c840344fd618f68ac54a90d2618a5b76e1f308d94fead36a80e7" Jul 16 22:55:25.633308 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:25.633280 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:55:25.633368 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:25.633353 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:55:25.633403 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:25.633386 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:55:26.638836 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:26.638795 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" event={"ID":"3693422a-5443-4d35-94f0-6d7ec3b19916","Type":"ContainerStarted","Data":"23de89a7d55506fadb4d8490766c04913fa0dab612ee540a52cc2b22244a0d43"} Jul 16 22:55:27.212899 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:27.212864 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:27.213122 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:27.213101 2578 patch_prober.go:28] interesting pod/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 16 22:55:27.213184 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:27.213151 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" podUID="3693422a-5443-4d35-94f0-6d7ec3b19916" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 16 22:55:28.212915 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:28.212878 2578 patch_prober.go:28] interesting pod/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 16 22:55:28.213332 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:28.212935 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" podUID="3693422a-5443-4d35-94f0-6d7ec3b19916" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 16 22:55:29.213427 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:29.213393 2578 patch_prober.go:28] interesting pod/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 16 22:55:29.213831 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:29.213446 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" podUID="3693422a-5443-4d35-94f0-6d7ec3b19916" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 16 22:55:30.213706 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:30.213669 2578 patch_prober.go:28] interesting pod/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 16 22:55:30.214127 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:30.213733 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" podUID="3693422a-5443-4d35-94f0-6d7ec3b19916" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 16 22:55:31.216550 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:31.216512 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:31.216931 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:31.216836 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:31.217613 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:31.217596 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:55:47.968418 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:47.968330 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v"] Jul 16 22:55:47.968885 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:47.968587 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" podUID="37518409-94ba-4a4e-a262-523fb3f98464" containerName="istio-proxy" containerID="cri-o://0efcf490493f636f58a0983b570355e6488d8c75b9ba309e2a714efa07f793f6" gracePeriod=30 Jul 16 22:55:50.495631 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:50.495594 2578 patch_prober.go:28] interesting pod/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 16 22:55:50.496014 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:50.495646 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" podUID="37518409-94ba-4a4e-a262-523fb3f98464" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 22:55:53.225307 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.225281 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:55:53.308909 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.308840 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-workload-socket\") pod \"37518409-94ba-4a4e-a262-523fb3f98464\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " Jul 16 22:55:53.308909 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.308893 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-istio-data\") pod \"37518409-94ba-4a4e-a262-523fb3f98464\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " Jul 16 22:55:53.309095 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.308949 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37518409-94ba-4a4e-a262-523fb3f98464-istiod-ca-cert\") pod \"37518409-94ba-4a4e-a262-523fb3f98464\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " Jul 16 22:55:53.309095 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.308975 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-istio-envoy\") pod \"37518409-94ba-4a4e-a262-523fb3f98464\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " Jul 16 22:55:53.309095 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.309045 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-workload-certs\") pod \"37518409-94ba-4a4e-a262-523fb3f98464\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " Jul 16 22:55:53.309095 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.309089 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37518409-94ba-4a4e-a262-523fb3f98464-istio-token\") pod \"37518409-94ba-4a4e-a262-523fb3f98464\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " Jul 16 22:55:53.309344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.309128 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-credential-socket\") pod \"37518409-94ba-4a4e-a262-523fb3f98464\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " Jul 16 22:55:53.309344 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.309149 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "37518409-94ba-4a4e-a262-523fb3f98464" (UID: "37518409-94ba-4a4e-a262-523fb3f98464"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:55:53.309451 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.309338 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkq5s\" (UniqueName: \"kubernetes.io/projected/37518409-94ba-4a4e-a262-523fb3f98464-kube-api-access-rkq5s\") pod \"37518409-94ba-4a4e-a262-523fb3f98464\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " Jul 16 22:55:53.309451 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.309376 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37518409-94ba-4a4e-a262-523fb3f98464-istio-podinfo\") pod \"37518409-94ba-4a4e-a262-523fb3f98464\" (UID: \"37518409-94ba-4a4e-a262-523fb3f98464\") " Jul 16 22:55:53.309451 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.309401 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "37518409-94ba-4a4e-a262-523fb3f98464" (UID: "37518409-94ba-4a4e-a262-523fb3f98464"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:55:53.309451 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.309438 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37518409-94ba-4a4e-a262-523fb3f98464-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "37518409-94ba-4a4e-a262-523fb3f98464" (UID: "37518409-94ba-4a4e-a262-523fb3f98464"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:55:53.309757 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.309721 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "37518409-94ba-4a4e-a262-523fb3f98464" (UID: "37518409-94ba-4a4e-a262-523fb3f98464"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:55:53.310100 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.309895 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-istio-data" (OuterVolumeSpecName: "istio-data") pod "37518409-94ba-4a4e-a262-523fb3f98464" (UID: "37518409-94ba-4a4e-a262-523fb3f98464"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:55:53.310100 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.310031 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-istio-data\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:55:53.310100 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.310048 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37518409-94ba-4a4e-a262-523fb3f98464-istiod-ca-cert\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:55:53.310100 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.310062 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-workload-certs\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:55:53.310100 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.310097 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-credential-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:55:53.310402 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.310110 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-workload-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:55:53.311523 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.311496 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37518409-94ba-4a4e-a262-523fb3f98464-istio-token" (OuterVolumeSpecName: "istio-token") pod "37518409-94ba-4a4e-a262-523fb3f98464" (UID: "37518409-94ba-4a4e-a262-523fb3f98464"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:55:53.311884 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.311858 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37518409-94ba-4a4e-a262-523fb3f98464-kube-api-access-rkq5s" (OuterVolumeSpecName: "kube-api-access-rkq5s") pod "37518409-94ba-4a4e-a262-523fb3f98464" (UID: "37518409-94ba-4a4e-a262-523fb3f98464"). InnerVolumeSpecName "kube-api-access-rkq5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:55:53.311975 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.311929 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "37518409-94ba-4a4e-a262-523fb3f98464" (UID: "37518409-94ba-4a4e-a262-523fb3f98464"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:55:53.312015 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.311971 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/37518409-94ba-4a4e-a262-523fb3f98464-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "37518409-94ba-4a4e-a262-523fb3f98464" (UID: "37518409-94ba-4a4e-a262-523fb3f98464"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 22:55:53.410755 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.410731 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37518409-94ba-4a4e-a262-523fb3f98464-istio-envoy\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:55:53.410755 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.410753 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37518409-94ba-4a4e-a262-523fb3f98464-istio-token\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:55:53.410889 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.410763 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkq5s\" (UniqueName: \"kubernetes.io/projected/37518409-94ba-4a4e-a262-523fb3f98464-kube-api-access-rkq5s\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:55:53.410889 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.410773 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37518409-94ba-4a4e-a262-523fb3f98464-istio-podinfo\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:55:53.790390 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.790353 2578 generic.go:356] "Generic (PLEG): container finished" podID="37518409-94ba-4a4e-a262-523fb3f98464" containerID="0efcf490493f636f58a0983b570355e6488d8c75b9ba309e2a714efa07f793f6" exitCode=0 Jul 16 22:55:53.790564 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.790408 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" Jul 16 22:55:53.790564 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.790408 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" event={"ID":"37518409-94ba-4a4e-a262-523fb3f98464","Type":"ContainerDied","Data":"0efcf490493f636f58a0983b570355e6488d8c75b9ba309e2a714efa07f793f6"} Jul 16 22:55:53.790564 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.790529 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v" event={"ID":"37518409-94ba-4a4e-a262-523fb3f98464","Type":"ContainerDied","Data":"75b53b910ccf53d22b3c2d488f661eac46d20f4eaea563f500d1726168386f33"} Jul 16 22:55:53.790564 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.790560 2578 scope.go:117] "RemoveContainer" containerID="0efcf490493f636f58a0983b570355e6488d8c75b9ba309e2a714efa07f793f6" Jul 16 22:55:53.800575 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.800557 2578 scope.go:117] "RemoveContainer" containerID="aa12e2c8c4b9b4f323c9565c65a19ef238674553574f5c4b55ae40e7bd9e10bc" Jul 16 22:55:53.808481 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.808465 2578 scope.go:117] "RemoveContainer" containerID="0efcf490493f636f58a0983b570355e6488d8c75b9ba309e2a714efa07f793f6" Jul 16 22:55:53.808734 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:55:53.808715 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0efcf490493f636f58a0983b570355e6488d8c75b9ba309e2a714efa07f793f6\": container with ID starting with 0efcf490493f636f58a0983b570355e6488d8c75b9ba309e2a714efa07f793f6 not found: ID does not exist" containerID="0efcf490493f636f58a0983b570355e6488d8c75b9ba309e2a714efa07f793f6" Jul 16 22:55:53.808816 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.808748 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0efcf490493f636f58a0983b570355e6488d8c75b9ba309e2a714efa07f793f6"} err="failed to get container status \"0efcf490493f636f58a0983b570355e6488d8c75b9ba309e2a714efa07f793f6\": rpc error: code = NotFound desc = could not find container \"0efcf490493f636f58a0983b570355e6488d8c75b9ba309e2a714efa07f793f6\": container with ID starting with 0efcf490493f636f58a0983b570355e6488d8c75b9ba309e2a714efa07f793f6 not found: ID does not exist" Jul 16 22:55:53.808816 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.808770 2578 scope.go:117] "RemoveContainer" containerID="aa12e2c8c4b9b4f323c9565c65a19ef238674553574f5c4b55ae40e7bd9e10bc" Jul 16 22:55:53.809007 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:55:53.808989 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa12e2c8c4b9b4f323c9565c65a19ef238674553574f5c4b55ae40e7bd9e10bc\": container with ID starting with aa12e2c8c4b9b4f323c9565c65a19ef238674553574f5c4b55ae40e7bd9e10bc not found: ID does not exist" containerID="aa12e2c8c4b9b4f323c9565c65a19ef238674553574f5c4b55ae40e7bd9e10bc" Jul 16 22:55:53.809053 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.809013 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa12e2c8c4b9b4f323c9565c65a19ef238674553574f5c4b55ae40e7bd9e10bc"} err="failed to get container status \"aa12e2c8c4b9b4f323c9565c65a19ef238674553574f5c4b55ae40e7bd9e10bc\": rpc error: code = NotFound desc = could not find container \"aa12e2c8c4b9b4f323c9565c65a19ef238674553574f5c4b55ae40e7bd9e10bc\": container with ID starting with aa12e2c8c4b9b4f323c9565c65a19ef238674553574f5c4b55ae40e7bd9e10bc not found: ID does not exist" Jul 16 22:55:53.813492 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.813468 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v"] Jul 16 22:55:53.818206 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:53.818182 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-ddb113-openshift-default-c5b69bb89-48j4v"] Jul 16 22:55:54.431310 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:55:54.431280 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37518409-94ba-4a4e-a262-523fb3f98464" path="/var/lib/kubelet/pods/37518409-94ba-4a4e-a262-523fb3f98464/volumes" Jul 16 22:56:15.153050 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:15.153010 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st"] Jul 16 22:56:15.153579 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:15.153342 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" podUID="3693422a-5443-4d35-94f0-6d7ec3b19916" containerName="istio-proxy" containerID="cri-o://23de89a7d55506fadb4d8490766c04913fa0dab612ee540a52cc2b22244a0d43" gracePeriod=30 Jul 16 22:56:16.048968 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.048934 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7"] Jul 16 22:56:16.049366 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.049353 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c69383de-a011-4002-8d4e-065d3879526a" containerName="istio-proxy" Jul 16 22:56:16.049415 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.049368 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c69383de-a011-4002-8d4e-065d3879526a" containerName="istio-proxy" Jul 16 22:56:16.049415 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.049389 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37518409-94ba-4a4e-a262-523fb3f98464" containerName="istio-proxy" Jul 16 22:56:16.049415 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.049396 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="37518409-94ba-4a4e-a262-523fb3f98464" containerName="istio-proxy" Jul 16 22:56:16.049415 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.049404 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37518409-94ba-4a4e-a262-523fb3f98464" containerName="istio-proxy" Jul 16 22:56:16.049415 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.049410 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="37518409-94ba-4a4e-a262-523fb3f98464" containerName="istio-proxy" Jul 16 22:56:16.049570 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.049471 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="37518409-94ba-4a4e-a262-523fb3f98464" containerName="istio-proxy" Jul 16 22:56:16.049570 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.049478 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="37518409-94ba-4a4e-a262-523fb3f98464" containerName="istio-proxy" Jul 16 22:56:16.049570 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.049484 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c69383de-a011-4002-8d4e-065d3879526a" containerName="istio-proxy" Jul 16 22:56:16.052441 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.052424 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.055241 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.055219 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-35a77a-openshift-default-dockercfg-x6xsf\"" Jul 16 22:56:16.063625 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.063601 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7"] Jul 16 22:56:16.125891 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.125856 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-token\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.126043 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.125912 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-podinfo\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.126043 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.126009 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istiod-ca-cert\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.126170 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.126098 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-credential-socket\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.126170 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.126127 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcrbs\" (UniqueName: \"kubernetes.io/projected/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-kube-api-access-fcrbs\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.126170 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.126159 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-envoy\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.126309 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.126217 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-workload-socket\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.126309 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.126252 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-workload-certs\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.126309 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.126270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-data\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.218969 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.218934 2578 patch_prober.go:28] interesting pod/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 16 22:56:16.219366 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.218990 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" podUID="3693422a-5443-4d35-94f0-6d7ec3b19916" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 22:56:16.227794 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.227761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istiod-ca-cert\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.227933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.227815 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-credential-socket\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.227933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.227899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcrbs\" (UniqueName: \"kubernetes.io/projected/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-kube-api-access-fcrbs\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.227933 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.227921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-envoy\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.228065 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.227945 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-workload-socket\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.228065 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.227962 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-workload-certs\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.228065 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.227976 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-data\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.228065 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.228017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-token\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.228065 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.228045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-podinfo\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.228499 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.228351 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-credential-socket\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.228499 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.228439 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-workload-socket\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.228499 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.228472 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-workload-certs\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.228714 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.228499 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-data\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.228714 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.228591 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istiod-ca-cert\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.230275 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.230254 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-envoy\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.230526 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.230510 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-podinfo\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.245704 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.245680 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcrbs\" (UniqueName: \"kubernetes.io/projected/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-kube-api-access-fcrbs\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.248447 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.248426 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-token\") pod \"e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.364321 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.364242 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:16.509852 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.509827 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7"] Jul 16 22:56:16.512012 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:56:16.511984 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1feb0e50_019e_4d24_8bea_485eb0e1b7f9.slice/crio-32983e6767482a18af2437c84cfcc8bdbea2a879f6f216635ac89767be8ef367 WatchSource:0}: Error finding container 32983e6767482a18af2437c84cfcc8bdbea2a879f6f216635ac89767be8ef367: Status 404 returned error can't find the container with id 32983e6767482a18af2437c84cfcc8bdbea2a879f6f216635ac89767be8ef367 Jul 16 22:56:16.514152 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.514122 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:56:16.514234 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.514182 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:56:16.514234 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.514211 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:56:16.907543 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.907505 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" event={"ID":"1feb0e50-019e-4d24-8bea-485eb0e1b7f9","Type":"ContainerStarted","Data":"75c4ed369631c46d6c92db006805a819b920b3e217aba58f865a4ce49b5eb535"} Jul 16 22:56:16.907718 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.907566 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" event={"ID":"1feb0e50-019e-4d24-8bea-485eb0e1b7f9","Type":"ContainerStarted","Data":"32983e6767482a18af2437c84cfcc8bdbea2a879f6f216635ac89767be8ef367"} Jul 16 22:56:16.929410 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:16.929358 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" podStartSLOduration=0.929343771 podStartE2EDuration="929.343771ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:56:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:56:16.926179247 +0000 UTC m=+2543.028824494" watchObservedRunningTime="2026-07-16 22:56:16.929343771 +0000 UTC m=+2543.031988999" Jul 16 22:56:17.365248 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:17.365214 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:17.370227 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:17.370202 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:17.912401 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:17.912368 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:17.913218 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:17.913198 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:20.413451 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.413421 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:56:20.576972 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.576939 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3693422a-5443-4d35-94f0-6d7ec3b19916-istiod-ca-cert\") pod \"3693422a-5443-4d35-94f0-6d7ec3b19916\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " Jul 16 22:56:20.577263 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.576994 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-podinfo\") pod \"3693422a-5443-4d35-94f0-6d7ec3b19916\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " Jul 16 22:56:20.577263 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.577047 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-data\") pod \"3693422a-5443-4d35-94f0-6d7ec3b19916\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " Jul 16 22:56:20.577263 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.577063 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-workload-socket\") pod \"3693422a-5443-4d35-94f0-6d7ec3b19916\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " Jul 16 22:56:20.577263 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.577103 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-976f4\" (UniqueName: \"kubernetes.io/projected/3693422a-5443-4d35-94f0-6d7ec3b19916-kube-api-access-976f4\") pod \"3693422a-5443-4d35-94f0-6d7ec3b19916\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " Jul 16 22:56:20.577263 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.577151 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-credential-socket\") pod \"3693422a-5443-4d35-94f0-6d7ec3b19916\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " Jul 16 22:56:20.577263 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.577180 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-token\") pod \"3693422a-5443-4d35-94f0-6d7ec3b19916\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " Jul 16 22:56:20.577263 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.577209 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-workload-certs\") pod \"3693422a-5443-4d35-94f0-6d7ec3b19916\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " Jul 16 22:56:20.577263 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.577266 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-envoy\") pod \"3693422a-5443-4d35-94f0-6d7ec3b19916\" (UID: \"3693422a-5443-4d35-94f0-6d7ec3b19916\") " Jul 16 22:56:20.577696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.577420 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3693422a-5443-4d35-94f0-6d7ec3b19916" (UID: "3693422a-5443-4d35-94f0-6d7ec3b19916"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:56:20.577696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.577481 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3693422a-5443-4d35-94f0-6d7ec3b19916-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3693422a-5443-4d35-94f0-6d7ec3b19916" (UID: "3693422a-5443-4d35-94f0-6d7ec3b19916"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:56:20.577696 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.577624 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3693422a-5443-4d35-94f0-6d7ec3b19916" (UID: "3693422a-5443-4d35-94f0-6d7ec3b19916"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:56:20.577956 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.577698 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3693422a-5443-4d35-94f0-6d7ec3b19916" (UID: "3693422a-5443-4d35-94f0-6d7ec3b19916"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:56:20.577956 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.577928 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-data" (OuterVolumeSpecName: "istio-data") pod "3693422a-5443-4d35-94f0-6d7ec3b19916" (UID: "3693422a-5443-4d35-94f0-6d7ec3b19916"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:56:20.578255 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.578230 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3693422a-5443-4d35-94f0-6d7ec3b19916-istiod-ca-cert\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:56:20.578373 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.578261 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-data\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:56:20.578373 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.578275 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-workload-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:56:20.578373 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.578289 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-credential-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:56:20.578373 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.578311 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-workload-certs\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:56:20.579381 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.579359 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3693422a-5443-4d35-94f0-6d7ec3b19916" (UID: "3693422a-5443-4d35-94f0-6d7ec3b19916"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 22:56:20.579479 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.579441 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3693422a-5443-4d35-94f0-6d7ec3b19916" (UID: "3693422a-5443-4d35-94f0-6d7ec3b19916"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:56:20.580016 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.579991 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-token" (OuterVolumeSpecName: "istio-token") pod "3693422a-5443-4d35-94f0-6d7ec3b19916" (UID: "3693422a-5443-4d35-94f0-6d7ec3b19916"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:56:20.580104 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.580021 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3693422a-5443-4d35-94f0-6d7ec3b19916-kube-api-access-976f4" (OuterVolumeSpecName: "kube-api-access-976f4") pod "3693422a-5443-4d35-94f0-6d7ec3b19916" (UID: "3693422a-5443-4d35-94f0-6d7ec3b19916"). InnerVolumeSpecName "kube-api-access-976f4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:56:20.678716 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.678689 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-envoy\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:56:20.678716 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.678715 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-podinfo\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:56:20.678870 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.678725 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-976f4\" (UniqueName: \"kubernetes.io/projected/3693422a-5443-4d35-94f0-6d7ec3b19916-kube-api-access-976f4\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:56:20.678870 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.678735 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3693422a-5443-4d35-94f0-6d7ec3b19916-istio-token\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 22:56:20.929405 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.929326 2578 generic.go:356] "Generic (PLEG): container finished" podID="3693422a-5443-4d35-94f0-6d7ec3b19916" containerID="23de89a7d55506fadb4d8490766c04913fa0dab612ee540a52cc2b22244a0d43" exitCode=0 Jul 16 22:56:20.929405 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.929371 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" Jul 16 22:56:20.929587 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.929414 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" event={"ID":"3693422a-5443-4d35-94f0-6d7ec3b19916","Type":"ContainerDied","Data":"23de89a7d55506fadb4d8490766c04913fa0dab612ee540a52cc2b22244a0d43"} Jul 16 22:56:20.929587 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.929471 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st" event={"ID":"3693422a-5443-4d35-94f0-6d7ec3b19916","Type":"ContainerDied","Data":"ad2a09444ddb0d87d5c94041bacc14c394bf4d06617c3e8e1f725a838222ea2a"} Jul 16 22:56:20.929587 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.929496 2578 scope.go:117] "RemoveContainer" containerID="23de89a7d55506fadb4d8490766c04913fa0dab612ee540a52cc2b22244a0d43" Jul 16 22:56:20.938959 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.938940 2578 scope.go:117] "RemoveContainer" containerID="4554ffe3aeb6c840344fd618f68ac54a90d2618a5b76e1f308d94fead36a80e7" Jul 16 22:56:20.946576 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.946559 2578 scope.go:117] "RemoveContainer" containerID="23de89a7d55506fadb4d8490766c04913fa0dab612ee540a52cc2b22244a0d43" Jul 16 22:56:20.946831 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:56:20.946808 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23de89a7d55506fadb4d8490766c04913fa0dab612ee540a52cc2b22244a0d43\": container with ID starting with 23de89a7d55506fadb4d8490766c04913fa0dab612ee540a52cc2b22244a0d43 not found: ID does not exist" containerID="23de89a7d55506fadb4d8490766c04913fa0dab612ee540a52cc2b22244a0d43" Jul 16 22:56:20.946931 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.946837 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23de89a7d55506fadb4d8490766c04913fa0dab612ee540a52cc2b22244a0d43"} err="failed to get container status \"23de89a7d55506fadb4d8490766c04913fa0dab612ee540a52cc2b22244a0d43\": rpc error: code = NotFound desc = could not find container \"23de89a7d55506fadb4d8490766c04913fa0dab612ee540a52cc2b22244a0d43\": container with ID starting with 23de89a7d55506fadb4d8490766c04913fa0dab612ee540a52cc2b22244a0d43 not found: ID does not exist" Jul 16 22:56:20.946931 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.946854 2578 scope.go:117] "RemoveContainer" containerID="4554ffe3aeb6c840344fd618f68ac54a90d2618a5b76e1f308d94fead36a80e7" Jul 16 22:56:20.947121 ip-10-0-132-127 kubenswrapper[2578]: E0716 22:56:20.947061 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4554ffe3aeb6c840344fd618f68ac54a90d2618a5b76e1f308d94fead36a80e7\": container with ID starting with 4554ffe3aeb6c840344fd618f68ac54a90d2618a5b76e1f308d94fead36a80e7 not found: ID does not exist" containerID="4554ffe3aeb6c840344fd618f68ac54a90d2618a5b76e1f308d94fead36a80e7" Jul 16 22:56:20.947180 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.947131 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4554ffe3aeb6c840344fd618f68ac54a90d2618a5b76e1f308d94fead36a80e7"} err="failed to get container status \"4554ffe3aeb6c840344fd618f68ac54a90d2618a5b76e1f308d94fead36a80e7\": rpc error: code = NotFound desc = could not find container \"4554ffe3aeb6c840344fd618f68ac54a90d2618a5b76e1f308d94fead36a80e7\": container with ID starting with 4554ffe3aeb6c840344fd618f68ac54a90d2618a5b76e1f308d94fead36a80e7 not found: ID does not exist" Jul 16 22:56:20.973563 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.973536 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st"] Jul 16 22:56:20.984171 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:20.984150 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-ef186c-openshift-default-778d9b4779-2l5st"] Jul 16 22:56:22.431760 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:22.431725 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3693422a-5443-4d35-94f0-6d7ec3b19916" path="/var/lib/kubelet/pods/3693422a-5443-4d35-94f0-6d7ec3b19916/volumes" Jul 16 22:56:24.086985 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.086951 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn"] Jul 16 22:56:24.087406 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.087390 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3693422a-5443-4d35-94f0-6d7ec3b19916" containerName="istio-proxy" Jul 16 22:56:24.087406 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.087406 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3693422a-5443-4d35-94f0-6d7ec3b19916" containerName="istio-proxy" Jul 16 22:56:24.087478 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.087420 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3693422a-5443-4d35-94f0-6d7ec3b19916" containerName="istio-proxy" Jul 16 22:56:24.087478 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.087426 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3693422a-5443-4d35-94f0-6d7ec3b19916" containerName="istio-proxy" Jul 16 22:56:24.087548 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.087487 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3693422a-5443-4d35-94f0-6d7ec3b19916" containerName="istio-proxy" Jul 16 22:56:24.087548 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.087496 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3693422a-5443-4d35-94f0-6d7ec3b19916" containerName="istio-proxy" Jul 16 22:56:24.092037 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.092016 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.098619 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.098600 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-5159e9-openshift-default-dockercfg-79k8r\"" Jul 16 22:56:24.108092 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.108042 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn"] Jul 16 22:56:24.214118 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.214052 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l27gs\" (UniqueName: \"kubernetes.io/projected/e950c922-64bd-4220-a964-770009d76656-kube-api-access-l27gs\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.214287 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.214155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-istio-envoy\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.214287 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.214176 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-credential-socket\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.214287 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.214203 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e950c922-64bd-4220-a964-770009d76656-istio-token\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.214287 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.214223 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e950c922-64bd-4220-a964-770009d76656-istio-podinfo\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.214492 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.214331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-workload-socket\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.214492 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.214370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-istio-data\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.214492 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.214435 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-workload-certs\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.214492 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.214460 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e950c922-64bd-4220-a964-770009d76656-istiod-ca-cert\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.315115 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.315057 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-workload-socket\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.315115 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.315118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-istio-data\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.315373 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.315160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-workload-certs\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.315373 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.315185 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e950c922-64bd-4220-a964-770009d76656-istiod-ca-cert\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.315373 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.315331 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l27gs\" (UniqueName: \"kubernetes.io/projected/e950c922-64bd-4220-a964-770009d76656-kube-api-access-l27gs\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.315542 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.315417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-istio-envoy\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.315542 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.315446 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-credential-socket\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.315542 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.315459 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-workload-socket\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.315542 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.315488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e950c922-64bd-4220-a964-770009d76656-istio-token\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.315542 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.315491 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-istio-data\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.315542 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.315521 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e950c922-64bd-4220-a964-770009d76656-istio-podinfo\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.315836 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.315668 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-workload-certs\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.315836 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.315807 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-credential-socket\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.315977 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.315950 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e950c922-64bd-4220-a964-770009d76656-istiod-ca-cert\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.317649 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.317626 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-istio-envoy\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.318130 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.318113 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e950c922-64bd-4220-a964-770009d76656-istio-podinfo\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.324713 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.324688 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e950c922-64bd-4220-a964-770009d76656-istio-token\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.324794 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.324779 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l27gs\" (UniqueName: \"kubernetes.io/projected/e950c922-64bd-4220-a964-770009d76656-kube-api-access-l27gs\") pod \"e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.401906 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.401821 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:24.549250 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.549223 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn"] Jul 16 22:56:24.551115 ip-10-0-132-127 kubenswrapper[2578]: W0716 22:56:24.551086 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode950c922_64bd_4220_a964_770009d76656.slice/crio-c176b35e04c713e514337bd2c881334c91e53b451c128d2b62a776140707249f WatchSource:0}: Error finding container c176b35e04c713e514337bd2c881334c91e53b451c128d2b62a776140707249f: Status 404 returned error can't find the container with id c176b35e04c713e514337bd2c881334c91e53b451c128d2b62a776140707249f Jul 16 22:56:24.553304 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.553268 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:56:24.553374 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.553340 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:56:24.553374 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.553367 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:56:24.954160 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.954126 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" event={"ID":"e950c922-64bd-4220-a964-770009d76656","Type":"ContainerStarted","Data":"f2c1dbd68e23a47e5fe52ab230b9e88841d31e4bfb04ac8197fd5865f855c438"} Jul 16 22:56:24.954351 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.954180 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" event={"ID":"e950c922-64bd-4220-a964-770009d76656","Type":"ContainerStarted","Data":"c176b35e04c713e514337bd2c881334c91e53b451c128d2b62a776140707249f"} Jul 16 22:56:24.974893 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:24.974838 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" podStartSLOduration=0.97481782 podStartE2EDuration="974.81782ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:56:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:56:24.974372545 +0000 UTC m=+2551.077017773" watchObservedRunningTime="2026-07-16 22:56:24.97481782 +0000 UTC m=+2551.077463047" Jul 16 22:56:25.402317 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:25.402219 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:25.407369 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:25.407339 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:25.959451 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:25.959417 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:25.960391 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:25.960372 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:31.992433 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:31.992349 2578 generic.go:356] "Generic (PLEG): container finished" podID="1feb0e50-019e-4d24-8bea-485eb0e1b7f9" containerID="75c4ed369631c46d6c92db006805a819b920b3e217aba58f865a4ce49b5eb535" exitCode=0 Jul 16 22:56:31.992821 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:31.992427 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" event={"ID":"1feb0e50-019e-4d24-8bea-485eb0e1b7f9","Type":"ContainerDied","Data":"75c4ed369631c46d6c92db006805a819b920b3e217aba58f865a4ce49b5eb535"} Jul 16 22:56:31.992867 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:31.992827 2578 scope.go:117] "RemoveContainer" containerID="75c4ed369631c46d6c92db006805a819b920b3e217aba58f865a4ce49b5eb535" Jul 16 22:56:31.993944 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:31.993913 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:56:31.994013 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:31.993996 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:56:31.994064 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:31.994048 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:56:32.912313 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:32.912276 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:33.000998 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:33.000959 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" event={"ID":"1feb0e50-019e-4d24-8bea-485eb0e1b7f9","Type":"ContainerStarted","Data":"8ef15baf36927143f60aa537ff84def5edb35878d0dd240930db4d4223e1ab43"} Jul 16 22:56:33.365137 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:33.365090 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:33.366118 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:33.366092 2578 patch_prober.go:28] interesting pod/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 16 22:56:33.366241 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:33.366142 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" podUID="1feb0e50-019e-4d24-8bea-485eb0e1b7f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 16 22:56:34.365399 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:34.365355 2578 patch_prober.go:28] interesting pod/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 16 22:56:34.365999 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:34.365966 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" podUID="1feb0e50-019e-4d24-8bea-485eb0e1b7f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 16 22:56:35.365209 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:35.365163 2578 patch_prober.go:28] interesting pod/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 16 22:56:35.365528 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:35.365479 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" podUID="1feb0e50-019e-4d24-8bea-485eb0e1b7f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 16 22:56:36.365473 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:36.365432 2578 patch_prober.go:28] interesting pod/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 16 22:56:36.365755 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:36.365723 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" podUID="1feb0e50-019e-4d24-8bea-485eb0e1b7f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 16 22:56:37.368340 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:37.368310 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:37.368788 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:37.368598 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:37.369436 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:37.369416 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 22:56:40.960440 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:40.960401 2578 patch_prober.go:28] interesting pod/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 16 22:56:40.960951 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:40.960468 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" podUID="e950c922-64bd-4220-a964-770009d76656" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 16 22:56:41.048110 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:41.048054 2578 generic.go:356] "Generic (PLEG): container finished" podID="e950c922-64bd-4220-a964-770009d76656" containerID="f2c1dbd68e23a47e5fe52ab230b9e88841d31e4bfb04ac8197fd5865f855c438" exitCode=0 Jul 16 22:56:41.048290 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:41.048129 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" event={"ID":"e950c922-64bd-4220-a964-770009d76656","Type":"ContainerDied","Data":"f2c1dbd68e23a47e5fe52ab230b9e88841d31e4bfb04ac8197fd5865f855c438"} Jul 16 22:56:41.048552 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:41.048539 2578 scope.go:117] "RemoveContainer" containerID="f2c1dbd68e23a47e5fe52ab230b9e88841d31e4bfb04ac8197fd5865f855c438" Jul 16 22:56:41.049546 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:41.049522 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:56:41.049618 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:41.049588 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:56:41.049659 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:41.049625 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 22:56:42.055509 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:42.055474 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" event={"ID":"e950c922-64bd-4220-a964-770009d76656","Type":"ContainerStarted","Data":"c2d51ed393d70f8cd9ba5dba4deb68d9cd3c977870d6fe7276bb81f914f52c9a"} Jul 16 22:56:42.402386 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:42.402273 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:42.402581 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:42.402528 2578 patch_prober.go:28] interesting pod/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 16 22:56:42.402656 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:42.402584 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" podUID="e950c922-64bd-4220-a964-770009d76656" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 16 22:56:43.402979 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:43.402940 2578 patch_prober.go:28] interesting pod/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 16 22:56:43.403416 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:43.403001 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" podUID="e950c922-64bd-4220-a964-770009d76656" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 16 22:56:44.403215 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:44.403174 2578 patch_prober.go:28] interesting pod/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 16 22:56:44.403635 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:44.403238 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" podUID="e950c922-64bd-4220-a964-770009d76656" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 16 22:56:45.402308 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:45.402272 2578 patch_prober.go:28] interesting pod/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 16 22:56:45.402483 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:45.402328 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" podUID="e950c922-64bd-4220-a964-770009d76656" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 16 22:56:46.406670 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:46.406634 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:46.407129 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:46.406867 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:56:46.407473 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:56:46.407454 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 22:58:58.893084 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:58:58.892986 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 22:58:58.909119 ip-10-0-132-127 kubenswrapper[2578]: I0716 22:58:58.909094 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 23:03:09.094596 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:09.094562 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7"] Jul 16 23:03:09.095244 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:09.094791 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" podUID="1feb0e50-019e-4d24-8bea-485eb0e1b7f9" containerName="istio-proxy" containerID="cri-o://8ef15baf36927143f60aa537ff84def5edb35878d0dd240930db4d4223e1ab43" gracePeriod=30 Jul 16 23:03:14.353362 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.353329 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 23:03:14.394065 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.393977 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-data\") pod \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " Jul 16 23:03:14.394065 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.394049 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-workload-certs\") pod \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " Jul 16 23:03:14.394331 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.394112 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istiod-ca-cert\") pod \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " Jul 16 23:03:14.394331 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.394149 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-workload-socket\") pod \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " Jul 16 23:03:14.394331 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.394186 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcrbs\" (UniqueName: \"kubernetes.io/projected/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-kube-api-access-fcrbs\") pod \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " Jul 16 23:03:14.394331 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.394245 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-credential-socket\") pod \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " Jul 16 23:03:14.394331 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.394266 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1feb0e50-019e-4d24-8bea-485eb0e1b7f9" (UID: "1feb0e50-019e-4d24-8bea-485eb0e1b7f9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 23:03:14.394331 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.394299 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-podinfo\") pod \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " Jul 16 23:03:14.394686 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.394362 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-envoy\") pod \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " Jul 16 23:03:14.394686 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.394416 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-token\") pod \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\" (UID: \"1feb0e50-019e-4d24-8bea-485eb0e1b7f9\") " Jul 16 23:03:14.394686 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.394467 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1feb0e50-019e-4d24-8bea-485eb0e1b7f9" (UID: "1feb0e50-019e-4d24-8bea-485eb0e1b7f9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 23:03:14.394686 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.394470 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1feb0e50-019e-4d24-8bea-485eb0e1b7f9" (UID: "1feb0e50-019e-4d24-8bea-485eb0e1b7f9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 23:03:14.394686 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.394530 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1feb0e50-019e-4d24-8bea-485eb0e1b7f9" (UID: "1feb0e50-019e-4d24-8bea-485eb0e1b7f9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 23:03:14.394963 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.394749 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-workload-certs\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 23:03:14.394963 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.394765 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istiod-ca-cert\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 23:03:14.394963 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.394778 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-workload-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 23:03:14.394963 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.394791 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-credential-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 23:03:14.394963 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.394948 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-data" (OuterVolumeSpecName: "istio-data") pod "1feb0e50-019e-4d24-8bea-485eb0e1b7f9" (UID: "1feb0e50-019e-4d24-8bea-485eb0e1b7f9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 23:03:14.396593 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.396557 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-token" (OuterVolumeSpecName: "istio-token") pod "1feb0e50-019e-4d24-8bea-485eb0e1b7f9" (UID: "1feb0e50-019e-4d24-8bea-485eb0e1b7f9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 23:03:14.396773 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.396728 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1feb0e50-019e-4d24-8bea-485eb0e1b7f9" (UID: "1feb0e50-019e-4d24-8bea-485eb0e1b7f9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 23:03:14.396861 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.396841 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-kube-api-access-fcrbs" (OuterVolumeSpecName: "kube-api-access-fcrbs") pod "1feb0e50-019e-4d24-8bea-485eb0e1b7f9" (UID: "1feb0e50-019e-4d24-8bea-485eb0e1b7f9"). InnerVolumeSpecName "kube-api-access-fcrbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 23:03:14.396929 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.396887 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1feb0e50-019e-4d24-8bea-485eb0e1b7f9" (UID: "1feb0e50-019e-4d24-8bea-485eb0e1b7f9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 23:03:14.495514 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.495484 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-podinfo\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 23:03:14.495514 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.495511 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-envoy\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 23:03:14.495514 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.495521 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-token\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 23:03:14.495767 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.495530 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-istio-data\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 23:03:14.495767 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:14.495538 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcrbs\" (UniqueName: \"kubernetes.io/projected/1feb0e50-019e-4d24-8bea-485eb0e1b7f9-kube-api-access-fcrbs\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 23:03:15.078562 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:15.078523 2578 generic.go:356] "Generic (PLEG): container finished" podID="1feb0e50-019e-4d24-8bea-485eb0e1b7f9" containerID="8ef15baf36927143f60aa537ff84def5edb35878d0dd240930db4d4223e1ab43" exitCode=0 Jul 16 23:03:15.078762 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:15.078570 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" Jul 16 23:03:15.078762 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:15.078597 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" event={"ID":"1feb0e50-019e-4d24-8bea-485eb0e1b7f9","Type":"ContainerDied","Data":"8ef15baf36927143f60aa537ff84def5edb35878d0dd240930db4d4223e1ab43"} Jul 16 23:03:15.078762 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:15.078644 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7" event={"ID":"1feb0e50-019e-4d24-8bea-485eb0e1b7f9","Type":"ContainerDied","Data":"32983e6767482a18af2437c84cfcc8bdbea2a879f6f216635ac89767be8ef367"} Jul 16 23:03:15.078762 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:15.078667 2578 scope.go:117] "RemoveContainer" containerID="8ef15baf36927143f60aa537ff84def5edb35878d0dd240930db4d4223e1ab43" Jul 16 23:03:15.087540 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:15.087458 2578 scope.go:117] "RemoveContainer" containerID="75c4ed369631c46d6c92db006805a819b920b3e217aba58f865a4ce49b5eb535" Jul 16 23:03:15.095420 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:15.095401 2578 scope.go:117] "RemoveContainer" containerID="8ef15baf36927143f60aa537ff84def5edb35878d0dd240930db4d4223e1ab43" Jul 16 23:03:15.095669 ip-10-0-132-127 kubenswrapper[2578]: E0716 23:03:15.095651 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ef15baf36927143f60aa537ff84def5edb35878d0dd240930db4d4223e1ab43\": container with ID starting with 8ef15baf36927143f60aa537ff84def5edb35878d0dd240930db4d4223e1ab43 not found: ID does not exist" containerID="8ef15baf36927143f60aa537ff84def5edb35878d0dd240930db4d4223e1ab43" Jul 16 23:03:15.095713 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:15.095676 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ef15baf36927143f60aa537ff84def5edb35878d0dd240930db4d4223e1ab43"} err="failed to get container status \"8ef15baf36927143f60aa537ff84def5edb35878d0dd240930db4d4223e1ab43\": rpc error: code = NotFound desc = could not find container \"8ef15baf36927143f60aa537ff84def5edb35878d0dd240930db4d4223e1ab43\": container with ID starting with 8ef15baf36927143f60aa537ff84def5edb35878d0dd240930db4d4223e1ab43 not found: ID does not exist" Jul 16 23:03:15.095713 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:15.095693 2578 scope.go:117] "RemoveContainer" containerID="75c4ed369631c46d6c92db006805a819b920b3e217aba58f865a4ce49b5eb535" Jul 16 23:03:15.095947 ip-10-0-132-127 kubenswrapper[2578]: E0716 23:03:15.095930 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75c4ed369631c46d6c92db006805a819b920b3e217aba58f865a4ce49b5eb535\": container with ID starting with 75c4ed369631c46d6c92db006805a819b920b3e217aba58f865a4ce49b5eb535 not found: ID does not exist" containerID="75c4ed369631c46d6c92db006805a819b920b3e217aba58f865a4ce49b5eb535" Jul 16 23:03:15.095990 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:15.095953 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75c4ed369631c46d6c92db006805a819b920b3e217aba58f865a4ce49b5eb535"} err="failed to get container status \"75c4ed369631c46d6c92db006805a819b920b3e217aba58f865a4ce49b5eb535\": rpc error: code = NotFound desc = could not find container \"75c4ed369631c46d6c92db006805a819b920b3e217aba58f865a4ce49b5eb535\": container with ID starting with 75c4ed369631c46d6c92db006805a819b920b3e217aba58f865a4ce49b5eb535 not found: ID does not exist" Jul 16 23:03:15.098998 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:15.098977 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7"] Jul 16 23:03:15.105264 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:15.105234 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-35a77a-openshift-default-84c8cf6b5f-nppt7"] Jul 16 23:03:16.431397 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:16.431298 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1feb0e50-019e-4d24-8bea-485eb0e1b7f9" path="/var/lib/kubelet/pods/1feb0e50-019e-4d24-8bea-485eb0e1b7f9/volumes" Jul 16 23:03:31.185518 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:31.185485 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn"] Jul 16 23:03:31.186004 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:31.185742 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" podUID="e950c922-64bd-4220-a964-770009d76656" containerName="istio-proxy" containerID="cri-o://c2d51ed393d70f8cd9ba5dba4deb68d9cd3c977870d6fe7276bb81f914f52c9a" gracePeriod=30 Jul 16 23:03:31.409485 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:31.409443 2578 patch_prober.go:28] interesting pod/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 16 23:03:31.409671 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:31.409508 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" podUID="e950c922-64bd-4220-a964-770009d76656" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 23:03:36.447449 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.447380 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 23:03:36.510877 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.510849 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-credential-socket\") pod \"e950c922-64bd-4220-a964-770009d76656\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " Jul 16 23:03:36.511053 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.510893 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-istio-envoy\") pod \"e950c922-64bd-4220-a964-770009d76656\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " Jul 16 23:03:36.511053 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.510917 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-workload-socket\") pod \"e950c922-64bd-4220-a964-770009d76656\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " Jul 16 23:03:36.511053 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.510940 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l27gs\" (UniqueName: \"kubernetes.io/projected/e950c922-64bd-4220-a964-770009d76656-kube-api-access-l27gs\") pod \"e950c922-64bd-4220-a964-770009d76656\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " Jul 16 23:03:36.511053 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.510959 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e950c922-64bd-4220-a964-770009d76656-istio-token\") pod \"e950c922-64bd-4220-a964-770009d76656\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " Jul 16 23:03:36.511053 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.510990 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e950c922-64bd-4220-a964-770009d76656-istiod-ca-cert\") pod \"e950c922-64bd-4220-a964-770009d76656\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " Jul 16 23:03:36.511053 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.511018 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-istio-data\") pod \"e950c922-64bd-4220-a964-770009d76656\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " Jul 16 23:03:36.511352 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.511140 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e950c922-64bd-4220-a964-770009d76656-istio-podinfo\") pod \"e950c922-64bd-4220-a964-770009d76656\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " Jul 16 23:03:36.511352 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.511167 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e950c922-64bd-4220-a964-770009d76656" (UID: "e950c922-64bd-4220-a964-770009d76656"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 23:03:36.511352 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.511225 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e950c922-64bd-4220-a964-770009d76656" (UID: "e950c922-64bd-4220-a964-770009d76656"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 23:03:36.511352 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.511246 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-workload-certs\") pod \"e950c922-64bd-4220-a964-770009d76656\" (UID: \"e950c922-64bd-4220-a964-770009d76656\") " Jul 16 23:03:36.511546 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.511473 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e950c922-64bd-4220-a964-770009d76656" (UID: "e950c922-64bd-4220-a964-770009d76656"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 23:03:36.511597 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.511547 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e950c922-64bd-4220-a964-770009d76656-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e950c922-64bd-4220-a964-770009d76656" (UID: "e950c922-64bd-4220-a964-770009d76656"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 23:03:36.511649 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.511608 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e950c922-64bd-4220-a964-770009d76656-istiod-ca-cert\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 23:03:36.511649 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.511622 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-workload-certs\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 23:03:36.511649 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.511637 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-credential-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 23:03:36.511649 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.511647 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-workload-socket\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 23:03:36.512088 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.512051 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-istio-data" (OuterVolumeSpecName: "istio-data") pod "e950c922-64bd-4220-a964-770009d76656" (UID: "e950c922-64bd-4220-a964-770009d76656"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 23:03:36.513311 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.513283 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e950c922-64bd-4220-a964-770009d76656" (UID: "e950c922-64bd-4220-a964-770009d76656"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 23:03:36.513400 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.513301 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e950c922-64bd-4220-a964-770009d76656-istio-token" (OuterVolumeSpecName: "istio-token") pod "e950c922-64bd-4220-a964-770009d76656" (UID: "e950c922-64bd-4220-a964-770009d76656"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 23:03:36.513400 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.513385 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e950c922-64bd-4220-a964-770009d76656-kube-api-access-l27gs" (OuterVolumeSpecName: "kube-api-access-l27gs") pod "e950c922-64bd-4220-a964-770009d76656" (UID: "e950c922-64bd-4220-a964-770009d76656"). InnerVolumeSpecName "kube-api-access-l27gs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 23:03:36.513536 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.513519 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e950c922-64bd-4220-a964-770009d76656-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e950c922-64bd-4220-a964-770009d76656" (UID: "e950c922-64bd-4220-a964-770009d76656"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 23:03:36.612506 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.612473 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-istio-envoy\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 23:03:36.612506 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.612507 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l27gs\" (UniqueName: \"kubernetes.io/projected/e950c922-64bd-4220-a964-770009d76656-kube-api-access-l27gs\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 23:03:36.612716 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.612521 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e950c922-64bd-4220-a964-770009d76656-istio-token\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 23:03:36.612716 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.612533 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e950c922-64bd-4220-a964-770009d76656-istio-data\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 23:03:36.612716 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:36.612544 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e950c922-64bd-4220-a964-770009d76656-istio-podinfo\") on node \"ip-10-0-132-127.ec2.internal\" DevicePath \"\"" Jul 16 23:03:37.204430 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:37.204397 2578 generic.go:356] "Generic (PLEG): container finished" podID="e950c922-64bd-4220-a964-770009d76656" containerID="c2d51ed393d70f8cd9ba5dba4deb68d9cd3c977870d6fe7276bb81f914f52c9a" exitCode=0 Jul 16 23:03:37.204609 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:37.204452 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" Jul 16 23:03:37.204609 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:37.204459 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" event={"ID":"e950c922-64bd-4220-a964-770009d76656","Type":"ContainerDied","Data":"c2d51ed393d70f8cd9ba5dba4deb68d9cd3c977870d6fe7276bb81f914f52c9a"} Jul 16 23:03:37.204609 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:37.204511 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn" event={"ID":"e950c922-64bd-4220-a964-770009d76656","Type":"ContainerDied","Data":"c176b35e04c713e514337bd2c881334c91e53b451c128d2b62a776140707249f"} Jul 16 23:03:37.204609 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:37.204532 2578 scope.go:117] "RemoveContainer" containerID="c2d51ed393d70f8cd9ba5dba4deb68d9cd3c977870d6fe7276bb81f914f52c9a" Jul 16 23:03:37.213870 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:37.213853 2578 scope.go:117] "RemoveContainer" containerID="f2c1dbd68e23a47e5fe52ab230b9e88841d31e4bfb04ac8197fd5865f855c438" Jul 16 23:03:37.222247 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:37.222226 2578 scope.go:117] "RemoveContainer" containerID="c2d51ed393d70f8cd9ba5dba4deb68d9cd3c977870d6fe7276bb81f914f52c9a" Jul 16 23:03:37.222478 ip-10-0-132-127 kubenswrapper[2578]: E0716 23:03:37.222456 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2d51ed393d70f8cd9ba5dba4deb68d9cd3c977870d6fe7276bb81f914f52c9a\": container with ID starting with c2d51ed393d70f8cd9ba5dba4deb68d9cd3c977870d6fe7276bb81f914f52c9a not found: ID does not exist" containerID="c2d51ed393d70f8cd9ba5dba4deb68d9cd3c977870d6fe7276bb81f914f52c9a" Jul 16 23:03:37.222521 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:37.222486 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d51ed393d70f8cd9ba5dba4deb68d9cd3c977870d6fe7276bb81f914f52c9a"} err="failed to get container status \"c2d51ed393d70f8cd9ba5dba4deb68d9cd3c977870d6fe7276bb81f914f52c9a\": rpc error: code = NotFound desc = could not find container \"c2d51ed393d70f8cd9ba5dba4deb68d9cd3c977870d6fe7276bb81f914f52c9a\": container with ID starting with c2d51ed393d70f8cd9ba5dba4deb68d9cd3c977870d6fe7276bb81f914f52c9a not found: ID does not exist" Jul 16 23:03:37.222521 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:37.222503 2578 scope.go:117] "RemoveContainer" containerID="f2c1dbd68e23a47e5fe52ab230b9e88841d31e4bfb04ac8197fd5865f855c438" Jul 16 23:03:37.222750 ip-10-0-132-127 kubenswrapper[2578]: E0716 23:03:37.222732 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2c1dbd68e23a47e5fe52ab230b9e88841d31e4bfb04ac8197fd5865f855c438\": container with ID starting with f2c1dbd68e23a47e5fe52ab230b9e88841d31e4bfb04ac8197fd5865f855c438 not found: ID does not exist" containerID="f2c1dbd68e23a47e5fe52ab230b9e88841d31e4bfb04ac8197fd5865f855c438" Jul 16 23:03:37.222792 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:37.222756 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2c1dbd68e23a47e5fe52ab230b9e88841d31e4bfb04ac8197fd5865f855c438"} err="failed to get container status \"f2c1dbd68e23a47e5fe52ab230b9e88841d31e4bfb04ac8197fd5865f855c438\": rpc error: code = NotFound desc = could not find container \"f2c1dbd68e23a47e5fe52ab230b9e88841d31e4bfb04ac8197fd5865f855c438\": container with ID starting with f2c1dbd68e23a47e5fe52ab230b9e88841d31e4bfb04ac8197fd5865f855c438 not found: ID does not exist" Jul 16 23:03:37.227915 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:37.227893 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn"] Jul 16 23:03:37.232928 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:37.232908 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-5159e9-openshift-default-5888567f79-cllcn"] Jul 16 23:03:38.431914 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:38.431879 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e950c922-64bd-4220-a964-770009d76656" path="/var/lib/kubelet/pods/e950c922-64bd-4220-a964-770009d76656/volumes" Jul 16 23:03:38.555272 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:38.555241 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7846b6849-hww68_bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0/copy-manifests/0.log" Jul 16 23:03:38.562985 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:38.562953 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7846b6849-hww68_bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0/manager/0.log" Jul 16 23:03:43.372830 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:43.372802 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4lc7x2_257a6c02-856b-42bc-a76d-94e92163d7de/istio-proxy/0.log" Jul 16 23:03:43.513681 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:43.513642 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6v4nw_05c5096a-e3cc-4e36-88e0-2b687c770280/discovery/0.log" Jul 16 23:03:43.872103 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:43.872055 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dzsmz_cb7d2d63-524e-421f-882b-7edd40fcf0ef/istio-proxy/1.log" Jul 16 23:03:44.846349 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:44.846317 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-q2mv6_f31a54dd-19d7-49f9-b471-11b168f13dd6/main/0.log" Jul 16 23:03:45.089994 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:45.089955 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-2hp79_031a8afb-edf3-41b2-9267-434532fafb79/main/0.log" Jul 16 23:03:54.011412 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:54.011379 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5kh2w_6af5cc45-24ab-41f7-93b0-2f257139bed2/global-pull-secret-syncer/0.log" Jul 16 23:03:54.214269 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:54.214234 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xvjcl_dd027fde-bcff-4cc5-a46c-37f4b1ec09b8/konnectivity-agent/0.log" Jul 16 23:03:54.239947 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:54.239916 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-127.ec2.internal_bfecc055662ef0ce2b1d85dad656ceb0/haproxy/0.log" Jul 16 23:03:58.925172 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:58.925141 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 23:03:58.941112 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:03:58.941089 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 23:04:00.412460 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:00.412431 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_daaebddc-3869-4807-b254-b329abe2a07f/alertmanager/0.log" Jul 16 23:04:00.434643 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:00.434610 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_daaebddc-3869-4807-b254-b329abe2a07f/config-reloader/0.log" Jul 16 23:04:00.456708 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:00.456682 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_daaebddc-3869-4807-b254-b329abe2a07f/kube-rbac-proxy-web/0.log" Jul 16 23:04:00.479523 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:00.479499 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_daaebddc-3869-4807-b254-b329abe2a07f/kube-rbac-proxy/0.log" Jul 16 23:04:00.500568 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:00.500549 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_daaebddc-3869-4807-b254-b329abe2a07f/kube-rbac-proxy-metric/0.log" Jul 16 23:04:00.520882 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:00.520862 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_daaebddc-3869-4807-b254-b329abe2a07f/prom-label-proxy/0.log" Jul 16 23:04:00.542014 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:00.541991 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_daaebddc-3869-4807-b254-b329abe2a07f/init-config-reloader/0.log" Jul 16 23:04:00.590578 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:00.590553 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-t7slq_5b5980c2-7b9e-4074-bfef-4ac10d58cd34/cluster-monitoring-operator/0.log" Jul 16 23:04:00.708475 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:00.708438 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-59f484df5-2kvc2_9b6905f1-d700-41c0-af29-1649dae716fd/metrics-server/0.log" Jul 16 23:04:00.857263 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:00.857231 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dtwkf_00e3beb3-5c49-4d5c-b333-1403b22347bc/node-exporter/0.log" Jul 16 23:04:00.883835 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:00.883809 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dtwkf_00e3beb3-5c49-4d5c-b333-1403b22347bc/kube-rbac-proxy/0.log" Jul 16 23:04:00.904025 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:00.904008 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dtwkf_00e3beb3-5c49-4d5c-b333-1403b22347bc/init-textfile/0.log" Jul 16 23:04:01.035240 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:01.035177 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-q2n7k_57e4b677-2f13-4793-9a14-4a0ce1d1b363/kube-rbac-proxy-main/0.log" Jul 16 23:04:01.062177 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:01.062158 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-q2n7k_57e4b677-2f13-4793-9a14-4a0ce1d1b363/kube-rbac-proxy-self/0.log" Jul 16 23:04:01.084828 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:01.084800 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-q2n7k_57e4b677-2f13-4793-9a14-4a0ce1d1b363/openshift-state-metrics/0.log" Jul 16 23:04:01.375251 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:01.375174 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-rr85x_5272c9e2-42e5-4233-bec5-742436d7b47a/prometheus-operator/0.log" Jul 16 23:04:01.396490 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:01.396466 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-rr85x_5272c9e2-42e5-4233-bec5-742436d7b47a/kube-rbac-proxy/0.log" Jul 16 23:04:01.421873 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:01.421845 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-d75pn_172dd88f-b709-47a1-9083-9fe60bc22fea/prometheus-operator-admission-webhook/0.log" Jul 16 23:04:01.456666 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:01.456646 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56f946f45c-c4tgg_f64bd23d-2487-40ad-9252-5dd9118eb764/telemeter-client/0.log" Jul 16 23:04:01.482203 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:01.482159 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56f946f45c-c4tgg_f64bd23d-2487-40ad-9252-5dd9118eb764/reload/0.log" Jul 16 23:04:01.504919 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:01.504899 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56f946f45c-c4tgg_f64bd23d-2487-40ad-9252-5dd9118eb764/kube-rbac-proxy/0.log" Jul 16 23:04:01.555382 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:01.555359 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cd99c4445-hds6x_0d40b540-5b8a-47d0-9e71-d36813e33411/thanos-query/0.log" Jul 16 23:04:01.576903 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:01.576880 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cd99c4445-hds6x_0d40b540-5b8a-47d0-9e71-d36813e33411/kube-rbac-proxy-web/0.log" Jul 16 23:04:01.598418 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:01.598397 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cd99c4445-hds6x_0d40b540-5b8a-47d0-9e71-d36813e33411/kube-rbac-proxy/0.log" Jul 16 23:04:01.619448 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:01.619421 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cd99c4445-hds6x_0d40b540-5b8a-47d0-9e71-d36813e33411/prom-label-proxy/0.log" Jul 16 23:04:01.641834 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:01.641757 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cd99c4445-hds6x_0d40b540-5b8a-47d0-9e71-d36813e33411/kube-rbac-proxy-rules/0.log" Jul 16 23:04:01.660892 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:01.660872 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cd99c4445-hds6x_0d40b540-5b8a-47d0-9e71-d36813e33411/kube-rbac-proxy-metrics/0.log" Jul 16 23:04:03.661431 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:03.661399 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/1.log" Jul 16 23:04:03.669403 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:03.669353 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mx9vm_8cdcab86-40b1-4f9f-b6cb-d95773289927/console-operator/2.log" Jul 16 23:04:03.904726 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:03.904688 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz"] Jul 16 23:04:03.905277 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:03.905251 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1feb0e50-019e-4d24-8bea-485eb0e1b7f9" containerName="istio-proxy" Jul 16 23:04:03.905277 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:03.905277 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1feb0e50-019e-4d24-8bea-485eb0e1b7f9" containerName="istio-proxy" Jul 16 23:04:03.905459 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:03.905294 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e950c922-64bd-4220-a964-770009d76656" containerName="istio-proxy" Jul 16 23:04:03.905459 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:03.905303 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e950c922-64bd-4220-a964-770009d76656" containerName="istio-proxy" Jul 16 23:04:03.905459 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:03.905317 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1feb0e50-019e-4d24-8bea-485eb0e1b7f9" containerName="istio-proxy" Jul 16 23:04:03.905459 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:03.905325 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1feb0e50-019e-4d24-8bea-485eb0e1b7f9" containerName="istio-proxy" Jul 16 23:04:03.905459 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:03.905336 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e950c922-64bd-4220-a964-770009d76656" containerName="istio-proxy" Jul 16 23:04:03.905459 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:03.905345 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e950c922-64bd-4220-a964-770009d76656" containerName="istio-proxy" Jul 16 23:04:03.905459 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:03.905422 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1feb0e50-019e-4d24-8bea-485eb0e1b7f9" containerName="istio-proxy" Jul 16 23:04:03.905459 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:03.905439 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e950c922-64bd-4220-a964-770009d76656" containerName="istio-proxy" Jul 16 23:04:03.905459 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:03.905448 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e950c922-64bd-4220-a964-770009d76656" containerName="istio-proxy" Jul 16 23:04:03.907953 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:03.907934 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" Jul 16 23:04:03.910548 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:03.910526 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kj5sf\"/\"kube-root-ca.crt\"" Jul 16 23:04:03.910677 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:03.910591 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kj5sf\"/\"openshift-service-ca.crt\"" Jul 16 23:04:03.912013 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:03.911948 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kj5sf\"/\"default-dockercfg-6lm9r\"" Jul 16 23:04:03.917834 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:03.917811 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz"] Jul 16 23:04:04.080322 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:04.080283 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsmdd\" (UniqueName: \"kubernetes.io/projected/1c7db59a-6d04-4366-ae42-4831636b42af-kube-api-access-lsmdd\") pod \"perf-node-gather-daemonset-mqddz\" (UID: \"1c7db59a-6d04-4366-ae42-4831636b42af\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" Jul 16 23:04:04.080322 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:04.080332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c7db59a-6d04-4366-ae42-4831636b42af-podres\") pod \"perf-node-gather-daemonset-mqddz\" (UID: \"1c7db59a-6d04-4366-ae42-4831636b42af\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" Jul 16 23:04:04.080532 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:04.080417 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c7db59a-6d04-4366-ae42-4831636b42af-proc\") pod \"perf-node-gather-daemonset-mqddz\" (UID: \"1c7db59a-6d04-4366-ae42-4831636b42af\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" Jul 16 23:04:04.080532 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:04.080448 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c7db59a-6d04-4366-ae42-4831636b42af-lib-modules\") pod \"perf-node-gather-daemonset-mqddz\" (UID: \"1c7db59a-6d04-4366-ae42-4831636b42af\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" Jul 16 23:04:04.080532 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:04.080486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c7db59a-6d04-4366-ae42-4831636b42af-sys\") pod \"perf-node-gather-daemonset-mqddz\" (UID: \"1c7db59a-6d04-4366-ae42-4831636b42af\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" Jul 16 23:04:04.181618 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:04.181528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsmdd\" (UniqueName: \"kubernetes.io/projected/1c7db59a-6d04-4366-ae42-4831636b42af-kube-api-access-lsmdd\") pod \"perf-node-gather-daemonset-mqddz\" (UID: \"1c7db59a-6d04-4366-ae42-4831636b42af\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" Jul 16 23:04:04.181618 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:04.181579 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c7db59a-6d04-4366-ae42-4831636b42af-podres\") pod \"perf-node-gather-daemonset-mqddz\" (UID: \"1c7db59a-6d04-4366-ae42-4831636b42af\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" Jul 16 23:04:04.181799 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:04.181633 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c7db59a-6d04-4366-ae42-4831636b42af-proc\") pod \"perf-node-gather-daemonset-mqddz\" (UID: \"1c7db59a-6d04-4366-ae42-4831636b42af\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" Jul 16 23:04:04.181799 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:04.181649 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c7db59a-6d04-4366-ae42-4831636b42af-lib-modules\") pod \"perf-node-gather-daemonset-mqddz\" (UID: \"1c7db59a-6d04-4366-ae42-4831636b42af\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" Jul 16 23:04:04.181799 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:04.181678 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c7db59a-6d04-4366-ae42-4831636b42af-sys\") pod \"perf-node-gather-daemonset-mqddz\" (UID: \"1c7db59a-6d04-4366-ae42-4831636b42af\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" Jul 16 23:04:04.181799 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:04.181744 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c7db59a-6d04-4366-ae42-4831636b42af-proc\") pod \"perf-node-gather-daemonset-mqddz\" (UID: \"1c7db59a-6d04-4366-ae42-4831636b42af\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" Jul 16 23:04:04.181799 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:04.181777 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c7db59a-6d04-4366-ae42-4831636b42af-sys\") pod \"perf-node-gather-daemonset-mqddz\" (UID: \"1c7db59a-6d04-4366-ae42-4831636b42af\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" Jul 16 23:04:04.181799 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:04.181777 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c7db59a-6d04-4366-ae42-4831636b42af-podres\") pod \"perf-node-gather-daemonset-mqddz\" (UID: \"1c7db59a-6d04-4366-ae42-4831636b42af\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" Jul 16 23:04:04.182049 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:04.181801 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c7db59a-6d04-4366-ae42-4831636b42af-lib-modules\") pod \"perf-node-gather-daemonset-mqddz\" (UID: \"1c7db59a-6d04-4366-ae42-4831636b42af\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" Jul 16 23:04:04.195990 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:04.195968 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsmdd\" (UniqueName: \"kubernetes.io/projected/1c7db59a-6d04-4366-ae42-4831636b42af-kube-api-access-lsmdd\") pod \"perf-node-gather-daemonset-mqddz\" (UID: \"1c7db59a-6d04-4366-ae42-4831636b42af\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" Jul 16 23:04:04.218698 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:04.218674 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" Jul 16 23:04:04.371412 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:04.371386 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz"] Jul 16 23:04:04.373425 ip-10-0-132-127 kubenswrapper[2578]: W0716 23:04:04.373395 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1c7db59a_6d04_4366_ae42_4831636b42af.slice/crio-16240a161abd075afee40d228eaaaf91b5f81392b969556ce24d45261db5274b WatchSource:0}: Error finding container 16240a161abd075afee40d228eaaaf91b5f81392b969556ce24d45261db5274b: Status 404 returned error can't find the container with id 16240a161abd075afee40d228eaaaf91b5f81392b969556ce24d45261db5274b Jul 16 23:04:04.438796 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:04.438773 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-bm4xf_64615f5e-5127-4c4a-9e3a-1f4562baabf5/download-server/0.log" Jul 16 23:04:05.354615 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:05.354574 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" event={"ID":"1c7db59a-6d04-4366-ae42-4831636b42af","Type":"ContainerStarted","Data":"5695199e392df670cf8f23e1b7b0eb2c4448beb9121bef9b522bf5d393b19f7d"} Jul 16 23:04:05.354990 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:05.354667 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" event={"ID":"1c7db59a-6d04-4366-ae42-4831636b42af","Type":"ContainerStarted","Data":"16240a161abd075afee40d228eaaaf91b5f81392b969556ce24d45261db5274b"} Jul 16 23:04:05.354990 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:05.354692 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" Jul 16 23:04:05.374526 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:05.374475 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" podStartSLOduration=2.374460173 podStartE2EDuration="2.374460173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 23:04:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 23:04:05.373269633 +0000 UTC m=+3011.475914860" watchObservedRunningTime="2026-07-16 23:04:05.374460173 +0000 UTC m=+3011.477105399" Jul 16 23:04:06.176684 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:06.176651 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tsh7f_d63ed4f5-feea-48bd-ab8b-c7249e46501b/dns/0.log" Jul 16 23:04:06.198301 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:06.198266 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tsh7f_d63ed4f5-feea-48bd-ab8b-c7249e46501b/kube-rbac-proxy/0.log" Jul 16 23:04:06.329084 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:06.329053 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sktxq_79fde428-77a9-46c5-8239-73be6e3df2c8/dns-node-resolver/0.log" Jul 16 23:04:06.891723 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:06.891684 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-d449d7d49-lqpdh_baef0f9d-77ac-432b-a7b3-44a7a9e2f560/registry/0.log" Jul 16 23:04:06.922188 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:06.922164 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-48dtb_d01020ff-0f0b-4e2a-b9a3-921a789917f6/node-ca/0.log" Jul 16 23:04:08.130580 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:08.130546 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4lc7x2_257a6c02-856b-42bc-a76d-94e92163d7de/istio-proxy/0.log" Jul 16 23:04:08.359412 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:08.359380 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6v4nw_05c5096a-e3cc-4e36-88e0-2b687c770280/discovery/0.log" Jul 16 23:04:08.487516 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:08.487455 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dzsmz_cb7d2d63-524e-421f-882b-7edd40fcf0ef/istio-proxy/0.log" Jul 16 23:04:08.546567 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:08.546529 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dzsmz_cb7d2d63-524e-421f-882b-7edd40fcf0ef/istio-proxy/1.log" Jul 16 23:04:09.437702 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:09.437668 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w89ct_b1a73a64-eee7-4065-9598-d8079291529a/serve-healthcheck-canary/0.log" Jul 16 23:04:09.947527 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:09.947490 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-x9kn9_1842e1a9-c878-48f6-a65c-97d722626fbd/insights-operator/0.log" Jul 16 23:04:09.948238 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:09.948210 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-x9kn9_1842e1a9-c878-48f6-a65c-97d722626fbd/insights-operator/1.log" Jul 16 23:04:09.973381 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:09.973356 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8gwwg_043789bd-6346-4456-b51f-714faa785b55/kube-rbac-proxy/0.log" Jul 16 23:04:10.001682 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:10.001647 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8gwwg_043789bd-6346-4456-b51f-714faa785b55/exporter/0.log" Jul 16 23:04:10.033462 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:10.033431 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8gwwg_043789bd-6346-4456-b51f-714faa785b55/extractor/0.log" Jul 16 23:04:11.372028 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:11.371994 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-mqddz" Jul 16 23:04:13.142751 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:13.142645 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7846b6849-hww68_bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0/manager/0.log" Jul 16 23:04:13.166711 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:13.166685 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7846b6849-hww68_bdd23c2f-2e16-4c57-b02c-fe7c7f955ff0/copy-manifests/0.log" Jul 16 23:04:14.093554 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:14.093463 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4lc7x2_257a6c02-856b-42bc-a76d-94e92163d7de/istio-proxy/0.log" Jul 16 23:04:14.312620 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:14.312578 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6v4nw_05c5096a-e3cc-4e36-88e0-2b687c770280/discovery/0.log" Jul 16 23:04:14.362698 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:14.362608 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dzsmz_cb7d2d63-524e-421f-882b-7edd40fcf0ef/istio-proxy/0.log" Jul 16 23:04:14.424000 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:14.423968 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dzsmz_cb7d2d63-524e-421f-882b-7edd40fcf0ef/istio-proxy/1.log" Jul 16 23:04:14.536024 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:14.535987 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-f787d6dbd-qhtf5_da0c4665-973f-46c3-a069-2f6cb4e3b84a/manager/0.log" Jul 16 23:04:15.742307 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:15.742262 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4lc7x2_257a6c02-856b-42bc-a76d-94e92163d7de/istio-proxy/0.log" Jul 16 23:04:15.951730 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:15.951699 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6v4nw_05c5096a-e3cc-4e36-88e0-2b687c770280/discovery/0.log" Jul 16 23:04:16.001996 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:16.001964 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dzsmz_cb7d2d63-524e-421f-882b-7edd40fcf0ef/istio-proxy/0.log" Jul 16 23:04:16.060673 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:16.060643 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dzsmz_cb7d2d63-524e-421f-882b-7edd40fcf0ef/istio-proxy/1.log" Jul 16 23:04:21.076881 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:21.076847 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2b2s7_a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec/kube-multus-additional-cni-plugins/0.log" Jul 16 23:04:21.099602 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:21.099577 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2b2s7_a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec/egress-router-binary-copy/0.log" Jul 16 23:04:21.119709 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:21.119683 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2b2s7_a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec/cni-plugins/0.log" Jul 16 23:04:21.141585 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:21.141557 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2b2s7_a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec/bond-cni-plugin/0.log" Jul 16 23:04:21.163482 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:21.163453 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2b2s7_a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec/routeoverride-cni/0.log" Jul 16 23:04:21.183834 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:21.183813 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2b2s7_a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec/whereabouts-cni-bincopy/0.log" Jul 16 23:04:21.203793 ip-10-0-132-127 kubenswrapper[2578]: I0716 23:04:21.203767 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2b2s7_a60f0805-2fd1-4a0b-aa68-e6c7cfc2acec/whereabouts-cni/0.log"