Jul 15 14:30:38.306299 ip-10-0-136-155 systemd[1]: Starting Kubernetes Kubelet... Jul 15 14:30:40.412713 ip-10-0-136-155 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 14:30:40.412713 ip-10-0-136-155 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 14:30:40.412713 ip-10-0-136-155 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 14:30:40.412713 ip-10-0-136-155 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 14:30:40.412713 ip-10-0-136-155 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 14:30:40.415467 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.415378 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 14:30:40.423712 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423686 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 14:30:40.423712 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423708 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 14:30:40.423712 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423712 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 14:30:40.423712 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423715 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 14:30:40.423712 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423718 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 14:30:40.423712 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423721 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423724 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423728 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423731 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423734 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423737 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423740 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423743 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423745 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423748 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423751 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423753 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423756 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423758 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423761 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423764 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423766 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423769 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423772 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423778 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 14:30:40.423949 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423781 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 14:30:40.424422 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423783 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 14:30:40.424422 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423786 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 14:30:40.424422 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423788 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 14:30:40.424422 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423791 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 14:30:40.424422 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423794 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 14:30:40.424422 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423796 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 14:30:40.424422 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423799 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 14:30:40.424422 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423801 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 14:30:40.424422 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423820 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 14:30:40.424422 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423824 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 14:30:40.424422 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423827 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 14:30:40.424422 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423831 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 14:30:40.424422 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423833 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 14:30:40.424422 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423836 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 14:30:40.424422 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423839 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 14:30:40.424422 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423842 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 14:30:40.424422 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423844 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 14:30:40.424422 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423847 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 14:30:40.424422 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423850 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423852 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423855 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423858 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423860 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423863 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423867 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423869 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423872 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423875 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423878 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423881 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423884 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423886 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423889 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423892 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423894 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423897 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423900 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423902 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 14:30:40.424915 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423905 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423908 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423910 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423913 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423915 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423918 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423920 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423924 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423926 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423929 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423931 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423934 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423939 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423943 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423946 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423950 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423953 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423956 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423959 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423963 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 14:30:40.425399 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423966 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 14:30:40.425903 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423970 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 14:30:40.425903 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423974 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 14:30:40.425903 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423978 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 14:30:40.425903 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423981 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 14:30:40.425903 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423983 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 14:30:40.425903 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423986 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 14:30:40.425903 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423988 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 14:30:40.425903 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423991 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 14:30:40.425903 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423993 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 14:30:40.425903 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.423996 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 14:30:40.425903 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424000 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 14:30:40.425903 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424003 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 14:30:40.425903 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424006 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 14:30:40.425903 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424008 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 14:30:40.425903 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424749 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 14:30:40.425903 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424756 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 14:30:40.425903 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424760 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 14:30:40.425903 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424763 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 14:30:40.425903 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424767 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424769 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424772 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424775 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424777 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424780 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424783 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424785 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424788 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424791 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424793 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424797 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424799 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424821 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424826 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424828 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424831 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424834 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424836 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424839 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 14:30:40.426350 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424841 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 14:30:40.426837 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424844 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 14:30:40.426837 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424847 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 14:30:40.426837 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424851 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 14:30:40.426837 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424855 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 14:30:40.426837 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424858 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 14:30:40.426837 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424860 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 14:30:40.426837 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424863 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 14:30:40.426837 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424866 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 14:30:40.426837 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424868 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 14:30:40.426837 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424870 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 14:30:40.426837 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424873 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 14:30:40.426837 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424876 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 15 14:30:40.426837 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424878 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 14:30:40.426837 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424881 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 14:30:40.426837 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424883 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 14:30:40.426837 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424886 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 14:30:40.426837 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424888 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 14:30:40.426837 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424891 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 14:30:40.426837 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424893 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 14:30:40.427295 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424897 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 14:30:40.427295 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424902 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 14:30:40.427295 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424905 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 14:30:40.427295 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424907 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 14:30:40.427295 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424910 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 14:30:40.427295 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424913 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 14:30:40.427295 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424920 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 14:30:40.427295 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424923 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 14:30:40.427295 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424926 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 14:30:40.427295 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424930 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 14:30:40.427295 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424933 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 14:30:40.427295 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424935 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 14:30:40.427295 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424938 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 14:30:40.427295 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424941 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 14:30:40.427295 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424944 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 14:30:40.427295 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424947 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 14:30:40.427295 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424950 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 14:30:40.427295 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424952 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 14:30:40.427295 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424955 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424958 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424961 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424964 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424967 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424970 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424973 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424975 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424979 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424981 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424984 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424986 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424989 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424991 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424994 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424996 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.424999 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425001 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425004 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425006 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 14:30:40.427745 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425010 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425015 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425018 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425020 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425023 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425025 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425028 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425031 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425033 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425037 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425040 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425043 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425047 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425050 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425053 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425056 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425059 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425515 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425522 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425526 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 14:30:40.428230 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425529 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425532 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425536 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425538 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425541 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425543 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425546 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425548 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425551 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425554 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425557 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425560 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425563 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425566 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425569 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425572 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425574 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425577 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425579 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425582 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 14:30:40.428775 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425584 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425588 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425590 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425594 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425597 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425600 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425603 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425605 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425608 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425611 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425619 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425622 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425625 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425628 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425630 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425633 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425635 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425638 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425640 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425642 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 14:30:40.429279 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425645 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 14:30:40.429813 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425647 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 14:30:40.429813 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425650 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 14:30:40.429813 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425652 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 14:30:40.429813 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425655 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 14:30:40.429813 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425658 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 14:30:40.429813 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425661 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 14:30:40.429813 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425663 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 14:30:40.429813 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425666 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 14:30:40.429813 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425669 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 14:30:40.429813 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425671 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 14:30:40.429813 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425674 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 14:30:40.429813 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425676 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 14:30:40.429813 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425679 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 14:30:40.429813 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425681 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 14:30:40.429813 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425684 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 14:30:40.429813 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425687 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 14:30:40.429813 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425689 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 14:30:40.429813 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425692 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 14:30:40.429813 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425694 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425697 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425699 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425701 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425704 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425706 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425708 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425711 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425713 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425716 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425718 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425724 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425727 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425730 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425732 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425735 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425737 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425740 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425742 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425745 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 14:30:40.430257 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425748 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425752 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425755 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425758 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425761 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425763 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425766 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425769 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425771 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425774 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425777 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425779 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425782 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425784 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425786 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425789 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.425791 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425877 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425886 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425892 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 14:30:40.430710 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425897 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425901 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425904 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425908 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425913 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425916 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425919 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425923 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425926 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425929 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425932 2565 flags.go:64] FLAG: --cgroup-root="" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425935 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425938 2565 flags.go:64] FLAG: --client-ca-file="" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425942 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425945 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425949 2565 flags.go:64] FLAG: --cluster-domain="" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425951 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425955 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425958 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425962 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425965 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425968 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425972 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 14:30:40.431197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425977 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425980 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425983 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425986 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425990 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425992 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.425996 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426000 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426002 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426005 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426008 2565 flags.go:64] FLAG: --enable-server="true" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426011 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426016 2565 flags.go:64] FLAG: --event-burst="100" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426019 2565 flags.go:64] FLAG: --event-qps="50" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426022 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426026 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426029 2565 flags.go:64] FLAG: --eviction-hard="" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426035 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426039 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426044 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426048 2565 flags.go:64] FLAG: --eviction-soft="" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426051 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426053 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426057 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426061 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 14:30:40.431752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426064 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426067 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426071 2565 flags.go:64] FLAG: --feature-gates="" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426075 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426078 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426081 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426084 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426089 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426092 2565 flags.go:64] FLAG: --help="false" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426095 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-136-155.ec2.internal" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426098 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426101 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426104 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426107 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426111 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426114 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426117 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426120 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426123 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426126 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426129 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426132 2565 flags.go:64] FLAG: --kube-reserved="" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426135 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426137 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 14:30:40.432382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426141 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426143 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426146 2565 flags.go:64] FLAG: --lock-file="" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426149 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426152 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426155 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426160 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426164 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426166 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426169 2565 flags.go:64] FLAG: --logging-format="text" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426173 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426176 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426179 2565 flags.go:64] FLAG: --manifest-url="" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426182 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426187 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426191 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426195 2565 flags.go:64] FLAG: --max-pods="110" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426198 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426201 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426204 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426207 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426210 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426212 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426215 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426223 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 14:30:40.433072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426226 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426229 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426232 2565 flags.go:64] FLAG: --pod-cidr="" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426235 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426240 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426243 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426246 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426248 2565 flags.go:64] FLAG: --port="10250" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426251 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426254 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e11b43b80535ca81" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426257 2565 flags.go:64] FLAG: --qos-reserved="" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426260 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426263 2565 flags.go:64] FLAG: --register-node="true" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426266 2565 flags.go:64] FLAG: --register-with-taints="" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426270 2565 flags.go:64] FLAG: --registry-burst="10" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426273 2565 flags.go:64] FLAG: --registry-qps="5" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426276 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426280 2565 flags.go:64] FLAG: --reserved-memory="" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426284 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426287 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426290 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426293 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426296 2565 flags.go:64] FLAG: --runonce="false" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426300 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426303 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 14:30:40.433686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426306 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426309 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426311 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426314 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426317 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426320 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426323 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426326 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426329 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426332 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426335 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426338 2565 flags.go:64] FLAG: --system-cgroups="" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426341 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426346 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426349 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426352 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426356 2565 flags.go:64] FLAG: --tls-min-version="" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426361 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426364 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426366 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426369 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426372 2565 flags.go:64] FLAG: --v="2" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426376 2565 flags.go:64] FLAG: --version="false" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426384 2565 flags.go:64] FLAG: --vmodule="" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426390 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 14:30:40.434305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.426393 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 14:30:40.434956 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426522 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 14:30:40.434956 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426526 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 14:30:40.434956 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426530 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 14:30:40.434956 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426533 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 14:30:40.434956 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426537 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 14:30:40.434956 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426540 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 14:30:40.434956 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426543 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 14:30:40.434956 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426545 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 14:30:40.434956 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426548 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 14:30:40.434956 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426552 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 14:30:40.434956 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426555 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 14:30:40.434956 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426558 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 14:30:40.434956 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426561 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 14:30:40.434956 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426564 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 14:30:40.434956 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426567 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 14:30:40.434956 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426570 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 14:30:40.434956 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426573 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 14:30:40.434956 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426576 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 14:30:40.434956 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426579 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426582 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426585 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426587 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426590 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426593 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426595 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426598 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426601 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426603 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426606 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426608 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426613 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426616 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426618 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426621 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426623 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426625 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426629 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426632 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 14:30:40.435410 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426634 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426637 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426639 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426641 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426644 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426646 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426649 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426651 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426654 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426656 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426659 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426661 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426664 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426666 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426669 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426671 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426673 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426676 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426679 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426681 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 14:30:40.435913 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426684 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 14:30:40.436391 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426686 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 14:30:40.436391 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426688 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 14:30:40.436391 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426691 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 14:30:40.436391 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426695 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 14:30:40.436391 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426698 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 14:30:40.436391 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426700 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 14:30:40.436391 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426703 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 14:30:40.436391 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426706 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 14:30:40.436391 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426709 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 14:30:40.436391 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426713 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 14:30:40.436391 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426715 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 14:30:40.436391 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426717 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 14:30:40.436391 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426720 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 14:30:40.436391 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426723 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 14:30:40.436391 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426725 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 14:30:40.436391 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426728 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 14:30:40.436391 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426732 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 14:30:40.436391 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426735 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 14:30:40.436391 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426738 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 14:30:40.436871 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426740 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 14:30:40.436871 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426743 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 14:30:40.436871 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426746 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 14:30:40.436871 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426748 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 14:30:40.436871 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426751 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 14:30:40.436871 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426754 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 14:30:40.436871 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426756 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 14:30:40.436871 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426759 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 14:30:40.436871 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426761 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 14:30:40.436871 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426764 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 14:30:40.436871 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426766 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 14:30:40.436871 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426770 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 14:30:40.436871 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426773 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 14:30:40.436871 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426776 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 14:30:40.436871 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426779 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 14:30:40.436871 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426782 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 14:30:40.436871 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426786 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 14:30:40.436871 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426788 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 14:30:40.436871 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426792 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 14:30:40.437316 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426794 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 14:30:40.437316 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.426797 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 14:30:40.437316 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.427312 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 14:30:40.437316 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.434151 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 14:30:40.437316 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.434172 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 14:30:40.437316 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.434196 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 14:30:40.437316 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.434201 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 14:30:40.437316 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434262 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 14:30:40.437316 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434267 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 14:30:40.437316 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434270 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 14:30:40.437316 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434274 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 14:30:40.437316 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434277 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 14:30:40.437316 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434280 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 14:30:40.437316 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434282 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 14:30:40.437670 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434285 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 14:30:40.437670 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434288 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 14:30:40.437670 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434291 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 14:30:40.437670 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434294 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 14:30:40.437670 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434297 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 14:30:40.437670 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434299 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 14:30:40.437670 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434303 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 14:30:40.437670 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434306 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 14:30:40.437670 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434309 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 14:30:40.437670 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434312 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 14:30:40.437670 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434314 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 14:30:40.437670 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434317 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 14:30:40.437670 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434320 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 14:30:40.437670 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434323 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 14:30:40.437670 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434326 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 14:30:40.437670 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434328 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 14:30:40.437670 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434331 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 14:30:40.437670 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434335 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 14:30:40.437670 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434339 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 14:30:40.438192 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434342 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 14:30:40.438192 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434345 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 14:30:40.438192 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434348 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 14:30:40.438192 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434356 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 14:30:40.438192 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434359 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 14:30:40.438192 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434362 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 14:30:40.438192 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434365 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 14:30:40.438192 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434367 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 14:30:40.438192 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434369 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 14:30:40.438192 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434372 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 14:30:40.438192 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434375 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 14:30:40.438192 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434377 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 14:30:40.438192 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434379 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 14:30:40.438192 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434382 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 14:30:40.438192 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434384 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 14:30:40.438192 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434387 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 14:30:40.438192 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434389 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 14:30:40.438192 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434392 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 14:30:40.438192 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434394 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434397 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434399 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434402 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434404 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434407 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434409 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434412 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434414 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434417 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434420 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434422 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434425 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434428 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434431 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434433 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434436 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434439 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434447 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434450 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 14:30:40.438678 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434452 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 14:30:40.439323 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434455 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 14:30:40.439323 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434457 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 14:30:40.439323 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434460 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 14:30:40.439323 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434462 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 14:30:40.439323 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434464 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 14:30:40.439323 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434467 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 14:30:40.439323 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434469 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 14:30:40.439323 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434473 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 14:30:40.439323 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434477 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 14:30:40.439323 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434480 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 14:30:40.439323 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434483 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 14:30:40.439323 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434486 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 14:30:40.439323 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434488 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 14:30:40.439323 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434491 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 14:30:40.439323 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434495 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 14:30:40.439323 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434498 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 14:30:40.439323 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434501 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 14:30:40.439323 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434503 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 14:30:40.439323 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434507 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 14:30:40.439773 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434509 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 14:30:40.439773 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434513 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 14:30:40.439773 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434515 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 14:30:40.439773 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434518 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 14:30:40.439773 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434521 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 14:30:40.439773 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434523 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 14:30:40.439773 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434526 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 14:30:40.439773 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434529 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 14:30:40.439773 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434531 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 14:30:40.439773 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434534 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 15 14:30:40.439773 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434536 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 14:30:40.439773 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434544 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 14:30:40.439773 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434547 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 14:30:40.439773 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434550 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 14:30:40.439773 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434553 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 14:30:40.440148 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.434558 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 14:30:40.440148 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434703 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 14:30:40.440148 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434708 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 14:30:40.440148 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434711 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 14:30:40.440148 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434714 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 14:30:40.440148 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434717 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 14:30:40.440148 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434722 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 14:30:40.440148 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434725 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 14:30:40.440148 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434728 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 14:30:40.440148 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434731 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 14:30:40.440148 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434734 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 14:30:40.440148 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434736 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 14:30:40.440148 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434739 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 14:30:40.440148 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434742 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 14:30:40.440148 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434745 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434747 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434750 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434753 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434756 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434759 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434762 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434765 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434767 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434770 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434773 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434776 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434779 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434782 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434784 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434792 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434795 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434797 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434800 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434816 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 14:30:40.440515 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434819 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434822 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434825 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434827 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434830 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434832 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434835 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434838 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434840 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434843 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434846 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434848 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434851 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434853 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434856 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434859 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434862 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434865 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434867 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434870 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 14:30:40.441011 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434872 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 14:30:40.441492 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434875 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 14:30:40.441492 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434877 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 14:30:40.441492 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434880 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 14:30:40.441492 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434882 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 14:30:40.441492 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434886 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 14:30:40.441492 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434890 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 14:30:40.441492 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434893 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 14:30:40.441492 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434901 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 14:30:40.441492 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434904 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 14:30:40.441492 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434907 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 14:30:40.441492 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434909 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 14:30:40.441492 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434912 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 14:30:40.441492 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434914 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 14:30:40.441492 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434917 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 14:30:40.441492 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434919 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 14:30:40.441492 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434922 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 14:30:40.441492 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434925 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 14:30:40.441492 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434927 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 14:30:40.441492 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434930 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 14:30:40.442053 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434932 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 14:30:40.442053 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434935 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 14:30:40.442053 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434937 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 14:30:40.442053 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434940 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 14:30:40.442053 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434942 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 14:30:40.442053 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434945 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 14:30:40.442053 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434948 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 14:30:40.442053 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434950 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 14:30:40.442053 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434953 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 14:30:40.442053 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434956 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 14:30:40.442053 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434960 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 14:30:40.442053 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434963 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 14:30:40.442053 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434965 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 14:30:40.442053 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434969 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 14:30:40.442053 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434972 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 14:30:40.442053 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434974 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 14:30:40.442053 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434977 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 14:30:40.442053 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434979 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 14:30:40.442053 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434982 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 14:30:40.442505 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434984 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 14:30:40.442505 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434987 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 14:30:40.442505 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434995 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 14:30:40.442505 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.434998 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 14:30:40.442505 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.435000 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 14:30:40.442505 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.435003 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 14:30:40.442505 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:40.435005 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 14:30:40.442505 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.435010 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 14:30:40.442505 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.435151 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 14:30:40.442505 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.437651 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 14:30:40.442505 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.438851 2565 server.go:1019] "Starting client certificate rotation" Jul 15 14:30:40.442505 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.438971 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 14:30:40.442505 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.439028 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 14:30:40.442915 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.441735 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 14:30:40.443923 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.443793 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 14:30:40.452383 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.452363 2565 log.go:25] "Validated CRI v1 runtime API" Jul 15 14:30:40.454389 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.454372 2565 log.go:25] "Validated CRI v1 image API" Jul 15 14:30:40.455302 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.455282 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 14:30:40.459895 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.459869 2565 fs.go:135] Filesystem UUIDs: map[24853aea-3a54-4a40-ab69-0dcfdb97356e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 fcdc6028-d4b7-4675-b94b-fb7e3b65dade:/dev/nvme0n1p3] Jul 15 14:30:40.459968 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.459894 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 14:30:40.466271 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.466159 2565 manager.go:216] Machine: {Timestamp:2026-07-15 14:30:40.464764925 +0000 UTC m=+0.337699476 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100282 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25394b92faa97060592e7145df912c SystemUUID:ec25394b-92fa-a970-6059-2e7145df912c BootID:196c592e-4de8-47ed-aa96-1285820734a3 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c3:7f:35:1a:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c3:7f:35:1a:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:51:d9:8d:68:24 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 14:30:40.466271 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.466266 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 14:30:40.466376 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.466351 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 14:30:40.469023 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.468999 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 14:30:40.469172 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.469024 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-155.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 14:30:40.469686 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.469676 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 14:30:40.469721 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.469689 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 14:30:40.469721 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.469697 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 14:30:40.470125 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.470115 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 14:30:40.471011 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.470996 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 14:30:40.471254 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.471243 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 14:30:40.474214 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.474202 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 15 14:30:40.474338 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.474329 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 14:30:40.474378 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.474358 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 15 14:30:40.474378 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.474368 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 14:30:40.474450 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.474385 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 14:30:40.474450 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.474398 2565 kubelet.go:398] "Adding apiserver pod source" Jul 15 14:30:40.474450 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.474407 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 14:30:40.474797 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.474784 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 14:30:40.474852 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.474822 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 14:30:40.476876 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.476858 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 14:30:40.478597 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.478583 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 14:30:40.478665 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.478612 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 14:30:40.478817 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.478793 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 14:30:40.478848 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.478827 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 14:30:40.478848 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.478834 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 14:30:40.478848 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.478840 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 14:30:40.478848 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.478847 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 14:30:40.478950 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.478853 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 14:30:40.479312 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.479304 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 14:30:40.479312 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.479312 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 14:30:40.479369 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.479323 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 14:30:40.479369 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.479329 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 14:30:40.479369 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.479337 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 14:30:40.479369 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.479345 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 14:30:40.480130 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.480121 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 14:30:40.480130 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.480130 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 14:30:40.483667 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.483650 2565 server.go:1268] "Started kubelet" Jul 15 14:30:40.487041 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.486981 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 14:30:40.487783 ip-10-0-136-155 systemd[1]: Started Kubernetes Kubelet. Jul 15 14:30:40.487948 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:40.487821 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 14:30:40.487948 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.487934 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-155.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 14:30:40.488153 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.488018 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 14:30:40.488153 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.488093 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 14:30:40.488321 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:40.488286 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-155.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 14:30:40.489765 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.489740 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 14:30:40.490836 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.490817 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 15 14:30:40.492201 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:40.492182 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 14:30:40.494902 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:40.493920 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-155.ec2.internal.18c27cffcc9eda29 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-155.ec2.internal,UID:ip-10-0-136-155.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-155.ec2.internal,},FirstTimestamp:2026-07-15 14:30:40.483605033 +0000 UTC m=+0.356539583,LastTimestamp:2026-07-15 14:30:40.483605033 +0000 UTC m=+0.356539583,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-155.ec2.internal,}" Jul 15 14:30:40.496410 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.496397 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 14:30:40.496495 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.496410 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 14:30:40.496495 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:40.496475 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 15 14:30:40.496957 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.496941 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 14:30:40.497072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.496944 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 14:30:40.497172 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.497075 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 14:30:40.497227 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.497187 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 15 14:30:40.497227 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.497195 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 15 14:30:40.497320 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.497222 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 14:30:40.497320 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.497238 2565 factory.go:55] Registering systemd factory Jul 15 14:30:40.497320 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.497247 2565 factory.go:223] Registration of the systemd container factory successfully Jul 15 14:30:40.497450 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.497432 2565 factory.go:153] Registering CRI-O factory Jul 15 14:30:40.497450 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.497447 2565 factory.go:223] Registration of the crio container factory successfully Jul 15 14:30:40.497542 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.497470 2565 factory.go:103] Registering Raw factory Jul 15 14:30:40.497542 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.497483 2565 manager.go:1196] Started watching for new ooms in manager Jul 15 14:30:40.498068 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.498052 2565 manager.go:349] Starting recovery of all containers Jul 15 14:30:40.498754 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:40.498731 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 14:30:40.498965 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:40.498928 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-155.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 14:30:40.500093 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.500069 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p6gqx" Jul 15 14:30:40.508291 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.508269 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p6gqx" Jul 15 14:30:40.508291 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.508276 2565 manager.go:354] Recovery completed Jul 15 14:30:40.509876 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:40.509854 2565 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 15 14:30:40.513053 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.513038 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 14:30:40.514995 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.514976 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 15 14:30:40.515058 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.515010 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 14:30:40.515058 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.515023 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 15 14:30:40.515661 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.515648 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 14:30:40.515661 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.515659 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 14:30:40.515744 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.515673 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 15 14:30:40.515744 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.515683 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 14:30:40.516422 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.516403 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 15 14:30:40.516495 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.516436 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 14:30:40.516495 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.516449 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 15 14:30:40.517376 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.517364 2565 policy_none.go:49] "None policy: Start" Jul 15 14:30:40.517417 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.517381 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 14:30:40.517417 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.517391 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 14:30:40.518342 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.518332 2565 policy_none.go:47] "Start" Jul 15 14:30:40.557534 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.557371 2565 manager.go:337] "Starting Device Plugin manager" Jul 15 14:30:40.557667 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:40.557568 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 14:30:40.557667 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.557581 2565 server.go:87] "Starting device plugin registration server" Jul 15 14:30:40.557886 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.557872 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 14:30:40.557980 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.557889 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 14:30:40.558029 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.557989 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 14:30:40.558085 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.558074 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 14:30:40.558085 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.558082 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 14:30:40.558557 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:40.558534 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 14:30:40.558658 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:40.558581 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-155.ec2.internal\" not found" Jul 15 14:30:40.658351 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.658266 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 14:30:40.659436 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.659282 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 15 14:30:40.659436 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.659310 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 14:30:40.659436 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.659320 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 15 14:30:40.659436 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.659346 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-155.ec2.internal" Jul 15 14:30:40.668068 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.668051 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-155.ec2.internal" Jul 15 14:30:40.668140 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:40.668076 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-155.ec2.internal\": node \"ip-10-0-136-155.ec2.internal\" not found" Jul 15 14:30:40.669049 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.669029 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 14:30:40.670318 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.670298 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 14:30:40.670395 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.670333 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 14:30:40.670395 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.670362 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 14:30:40.670473 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:40.670401 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 14:30:40.672438 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.672418 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 14:30:40.732228 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:40.732198 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 15 14:30:40.771319 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.771276 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal"] Jul 15 14:30:40.771406 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.771382 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 14:30:40.772391 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.772374 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 15 14:30:40.772468 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.772405 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 14:30:40.772468 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.772417 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 15 14:30:40.773816 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.773796 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 14:30:40.773920 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.773906 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 15 14:30:40.773959 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.773934 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 14:30:40.774745 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.774723 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 15 14:30:40.774857 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.774754 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 14:30:40.774857 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.774767 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 15 14:30:40.774960 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.774927 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 15 14:30:40.774960 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.774950 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 14:30:40.775049 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.774962 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 15 14:30:40.776508 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.776491 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" Jul 15 14:30:40.776595 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.776516 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 14:30:40.777266 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.777244 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 15 14:30:40.777348 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.777275 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 14:30:40.777348 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.777284 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 15 14:30:40.799385 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.799359 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27d6497d34fdf915d7c702237be63dc6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal\" (UID: \"27d6497d34fdf915d7c702237be63dc6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 15 14:30:40.799491 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.799402 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27d6497d34fdf915d7c702237be63dc6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal\" (UID: \"27d6497d34fdf915d7c702237be63dc6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 15 14:30:40.799491 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.799427 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f671eeaf614c8d693fab4bd5bb741bfd-config\") pod \"kube-apiserver-proxy-ip-10-0-136-155.ec2.internal\" (UID: \"f671eeaf614c8d693fab4bd5bb741bfd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" Jul 15 14:30:40.801570 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:40.801553 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-155.ec2.internal\" not found" node="ip-10-0-136-155.ec2.internal" Jul 15 14:30:40.805902 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:40.805884 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-155.ec2.internal\" not found" node="ip-10-0-136-155.ec2.internal" Jul 15 14:30:40.832507 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:40.832483 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 15 14:30:40.899892 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.899860 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27d6497d34fdf915d7c702237be63dc6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal\" (UID: \"27d6497d34fdf915d7c702237be63dc6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 15 14:30:40.899892 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.899893 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27d6497d34fdf915d7c702237be63dc6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal\" (UID: \"27d6497d34fdf915d7c702237be63dc6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 15 14:30:40.900071 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.899914 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f671eeaf614c8d693fab4bd5bb741bfd-config\") pod \"kube-apiserver-proxy-ip-10-0-136-155.ec2.internal\" (UID: \"f671eeaf614c8d693fab4bd5bb741bfd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" Jul 15 14:30:40.900071 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.899963 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27d6497d34fdf915d7c702237be63dc6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal\" (UID: \"27d6497d34fdf915d7c702237be63dc6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 15 14:30:40.900071 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.899963 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f671eeaf614c8d693fab4bd5bb741bfd-config\") pod \"kube-apiserver-proxy-ip-10-0-136-155.ec2.internal\" (UID: \"f671eeaf614c8d693fab4bd5bb741bfd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" Jul 15 14:30:40.900071 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:40.899971 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27d6497d34fdf915d7c702237be63dc6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal\" (UID: \"27d6497d34fdf915d7c702237be63dc6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 15 14:30:40.933094 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:40.933028 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 15 14:30:41.033889 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:41.033859 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 15 14:30:41.103395 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:41.103358 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 15 14:30:41.109425 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:41.109396 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" Jul 15 14:30:41.134964 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:41.134935 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 15 14:30:41.235529 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:41.235429 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 15 14:30:41.335918 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:41.335890 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 15 14:30:41.436582 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:41.436552 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 15 14:30:41.438725 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:41.438707 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 14:30:41.438931 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:41.438912 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 14:30:41.512092 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:41.512008 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 14:25:40 +0000 UTC" deadline="2028-02-12 11:23:39.041944097 +0000 UTC" Jul 15 14:30:41.512092 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:41.512038 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13844h52m57.529910398s" Jul 15 14:30:41.536786 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:41.536756 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 15 14:30:41.637423 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:41.637398 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 15 14:30:41.645531 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:41.645494 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf671eeaf614c8d693fab4bd5bb741bfd.slice/crio-58b972da73d7833c808db259290afc19ca385cd970afa90f5227bcca9b8bd168 WatchSource:0}: Error finding container 58b972da73d7833c808db259290afc19ca385cd970afa90f5227bcca9b8bd168: Status 404 returned error can't find the container with id 58b972da73d7833c808db259290afc19ca385cd970afa90f5227bcca9b8bd168 Jul 15 14:30:41.649834 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:41.649802 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 14:30:41.673302 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:41.673265 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" event={"ID":"f671eeaf614c8d693fab4bd5bb741bfd","Type":"ContainerStarted","Data":"58b972da73d7833c808db259290afc19ca385cd970afa90f5227bcca9b8bd168"} Jul 15 14:30:41.684303 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:41.684286 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 14:30:41.697311 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:41.697291 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 15 14:30:41.699118 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:41.699101 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 14:30:41.710880 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:41.710862 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 14:30:41.711921 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:41.711906 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" Jul 15 14:30:41.720211 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:41.720194 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 14:30:41.773050 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:41.772965 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 14:30:42.033258 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:42.033233 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d6497d34fdf915d7c702237be63dc6.slice/crio-d59a11ae71f00fe58a8f03df7ce24938a27d582f4f55f008ded161efa205990e WatchSource:0}: Error finding container d59a11ae71f00fe58a8f03df7ce24938a27d582f4f55f008ded161efa205990e: Status 404 returned error can't find the container with id d59a11ae71f00fe58a8f03df7ce24938a27d582f4f55f008ded161efa205990e Jul 15 14:30:42.348842 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.348746 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 14:30:42.475849 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.475814 2565 apiserver.go:52] "Watching apiserver" Jul 15 14:30:42.483733 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.483711 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 14:30:42.484157 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.484133 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-ddnm2","kube-system/konnectivity-agent-wjj78","kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal","openshift-dns/node-resolver-7gpxl","openshift-multus/multus-4d7ml","openshift-multus/multus-additional-cni-plugins-l4w7p","openshift-multus/network-metrics-daemon-sn4mn","openshift-network-diagnostics/network-check-target-jv5jr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg","openshift-cluster-node-tuning-operator/tuned-zvx9h","openshift-image-registry/node-ca-f5t4p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal","openshift-network-operator/iptables-alerter-4kkr2","openshift-ovn-kubernetes/ovnkube-node-rqjt9"] Jul 15 14:30:42.485424 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.485400 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:42.485536 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:42.485476 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sn4mn" podUID="081c09ac-5d7f-457e-b63a-354d4d4c793f" Jul 15 14:30:42.486559 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.486533 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4kkr2" Jul 15 14:30:42.487899 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.487881 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.489027 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.489007 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7gpxl" Jul 15 14:30:42.490424 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.490398 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.491546 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.491528 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.494156 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.494137 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.496101 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.496017 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:42.496101 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:42.496080 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddnm2" podUID="f1057e5f-10da-45d8-914f-2fec1ee7419b" Jul 15 14:30:42.497192 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.497077 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 14:30:42.497834 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.497800 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wjj78" Jul 15 14:30:42.498898 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.498877 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.500533 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.500513 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f5t4p" Jul 15 14:30:42.501646 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.501629 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 14:30:42.501987 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.501967 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:30:42.502076 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:42.502038 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jv5jr" podUID="5231db67-ee3e-41f3-9cc4-8819edeedb57" Jul 15 14:30:42.502530 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.502507 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 14:30:42.502622 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.502535 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 14:30:42.502622 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.502510 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 14:30:42.504844 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.504823 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 14:30:42.504925 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.504850 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 14:30:42.506222 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.505946 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 14:30:42.506222 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.506103 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 14:30:42.506222 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.506115 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 14:30:42.506222 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.506137 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dt96v\"" Jul 15 14:30:42.506463 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.506232 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d529f\"" Jul 15 14:30:42.506463 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.506250 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d85l6\"" Jul 15 14:30:42.506463 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.506397 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 14:30:42.506607 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.506493 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 14:30:42.506607 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.506548 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 14:30:42.506607 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.506498 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 14:30:42.507032 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.507011 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 14:30:42.508226 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.507542 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 14:30:42.508226 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.507659 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 14:30:42.508226 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.507731 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 14:30:42.508226 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.507766 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 14:30:42.508226 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.508030 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 14:30:42.508226 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.508220 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 14:30:42.508540 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.508470 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 14:30:42.508943 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.508595 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9xwxm\"" Jul 15 14:30:42.508943 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.508830 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b256m\"" Jul 15 14:30:42.508943 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.508938 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 14:30:42.508943 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.509149 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 14:30:42.508943 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.509405 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs\") pod \"network-metrics-daemon-sn4mn\" (UID: \"081c09ac-5d7f-457e-b63a-354d4d4c793f\") " pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:42.508943 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.509420 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 14:30:42.508943 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.509443 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/085f819f-4469-41c0-8e1b-94b275ddac97-cni-binary-copy\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.508943 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.509543 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 14:30:42.508943 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.509476 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gt5r\" (UniqueName: \"kubernetes.io/projected/95033e7d-b1fc-4636-8587-0303f98e3ded-kube-api-access-7gt5r\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.508943 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.509658 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-run-ovn-kubernetes\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.508943 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.509694 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2hvb\" (UniqueName: \"kubernetes.io/projected/081c09ac-5d7f-457e-b63a-354d4d4c793f-kube-api-access-t2hvb\") pod \"network-metrics-daemon-sn4mn\" (UID: \"081c09ac-5d7f-457e-b63a-354d4d4c793f\") " pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:42.508943 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.509760 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcqhw\" (UniqueName: \"kubernetes.io/projected/79dd4fed-463d-4100-8267-e2165857f17d-kube-api-access-tcqhw\") pod \"node-resolver-7gpxl\" (UID: \"79dd4fed-463d-4100-8267-e2165857f17d\") " pod="openshift-dns/node-resolver-7gpxl" Jul 15 14:30:42.508943 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.509790 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-os-release\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.508943 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.509855 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-multus-socket-dir-parent\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.510014 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7w6lm\"" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.510155 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-host-run-k8s-cni-cncf-io\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.510167 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.510209 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f13d742-97fe-4e14-b5a2-bbda928c3c2f-konnectivity-ca\") pod \"konnectivity-agent-wjj78\" (UID: \"6f13d742-97fe-4e14-b5a2-bbda928c3c2f\") " pod="kube-system/konnectivity-agent-wjj78" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.510238 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-systemd-units\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.510348 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-run-openvswitch\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.510369 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cwd8r\"" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.510407 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s8dvn\"" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.510424 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-system-cni-dir\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.510534 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.510554 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-hostroot\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.510603 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95033e7d-b1fc-4636-8587-0303f98e3ded-cnibin\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.510628 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-cni-bin\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.510825 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/29cee31f-448b-4475-ac84-e7778c196610-ovn-node-metrics-cert\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.510859 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-host-run-multus-certs\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.510927 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tj2x2\"" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.510933 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/29cee31f-448b-4475-ac84-e7778c196610-env-overrides\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.511026 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/29cee31f-448b-4475-ac84-e7778c196610-ovnkube-script-lib\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.511090 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-host-run-netns\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.512132 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.511122 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-cni-netd\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.513170 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.511181 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/29cee31f-448b-4475-ac84-e7778c196610-ovnkube-config\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.513170 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.511251 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c22eb984-70ae-410e-ad51-48a3a55ce8f5-host-slash\") pod \"iptables-alerter-4kkr2\" (UID: \"c22eb984-70ae-410e-ad51-48a3a55ce8f5\") " pod="openshift-network-operator/iptables-alerter-4kkr2" Jul 15 14:30:42.513170 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.511298 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95033e7d-b1fc-4636-8587-0303f98e3ded-cni-binary-copy\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.513170 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.511425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/35a5e520-4d79-4b8a-9954-5ab6f67d5412-socket-dir\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.513170 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.511472 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-run-netns\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.513170 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.511521 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-node-log\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.513170 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.511565 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-log-socket\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.513170 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.511606 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkng8\" (UniqueName: \"kubernetes.io/projected/085f819f-4469-41c0-8e1b-94b275ddac97-kube-api-access-vkng8\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.513170 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.511700 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95033e7d-b1fc-4636-8587-0303f98e3ded-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.513170 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.511769 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/35a5e520-4d79-4b8a-9954-5ab6f67d5412-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.513170 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.511823 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/35a5e520-4d79-4b8a-9954-5ab6f67d5412-etc-selinux\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.513170 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.511858 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-host-var-lib-kubelet\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.513170 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.511884 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95033e7d-b1fc-4636-8587-0303f98e3ded-system-cni-dir\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.513170 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.511942 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-kubelet\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.513170 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.511990 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-run-ovn\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.513170 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.512040 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79dd4fed-463d-4100-8267-e2165857f17d-tmp-dir\") pod \"node-resolver-7gpxl\" (UID: \"79dd4fed-463d-4100-8267-e2165857f17d\") " pod="openshift-dns/node-resolver-7gpxl" Jul 15 14:30:42.513940 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.512095 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-host-var-lib-cni-multus\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.513940 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.512129 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-multus-conf-dir\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.513940 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.512167 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95033e7d-b1fc-4636-8587-0303f98e3ded-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.513940 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.512204 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/35a5e520-4d79-4b8a-9954-5ab6f67d5412-sys-fs\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.513940 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.512248 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f1057e5f-10da-45d8-914f-2fec1ee7419b-dbus\") pod \"global-pull-secret-syncer-ddnm2\" (UID: \"f1057e5f-10da-45d8-914f-2fec1ee7419b\") " pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:42.513940 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.512278 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-host-var-lib-cni-bin\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.513940 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.512305 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f13d742-97fe-4e14-b5a2-bbda928c3c2f-agent-certs\") pod \"konnectivity-agent-wjj78\" (UID: \"6f13d742-97fe-4e14-b5a2-bbda928c3c2f\") " pod="kube-system/konnectivity-agent-wjj78" Jul 15 14:30:42.513940 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.512370 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f1057e5f-10da-45d8-914f-2fec1ee7419b-kubelet-config\") pod \"global-pull-secret-syncer-ddnm2\" (UID: \"f1057e5f-10da-45d8-914f-2fec1ee7419b\") " pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:42.513940 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.512441 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret\") pod \"global-pull-secret-syncer-ddnm2\" (UID: \"f1057e5f-10da-45d8-914f-2fec1ee7419b\") " pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:42.513940 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.512618 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c22eb984-70ae-410e-ad51-48a3a55ce8f5-iptables-alerter-script\") pod \"iptables-alerter-4kkr2\" (UID: \"c22eb984-70ae-410e-ad51-48a3a55ce8f5\") " pod="openshift-network-operator/iptables-alerter-4kkr2" Jul 15 14:30:42.513940 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.512670 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85zw2\" (UniqueName: \"kubernetes.io/projected/c22eb984-70ae-410e-ad51-48a3a55ce8f5-kube-api-access-85zw2\") pod \"iptables-alerter-4kkr2\" (UID: \"c22eb984-70ae-410e-ad51-48a3a55ce8f5\") " pod="openshift-network-operator/iptables-alerter-4kkr2" Jul 15 14:30:42.513940 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.512729 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95033e7d-b1fc-4636-8587-0303f98e3ded-os-release\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.514497 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.514166 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/35a5e520-4d79-4b8a-9954-5ab6f67d5412-registration-dir\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.514497 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.514211 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95033e7d-b1fc-4636-8587-0303f98e3ded-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.514497 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.514235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-etc-openvswitch\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.514497 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.514261 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/35a5e520-4d79-4b8a-9954-5ab6f67d5412-device-dir\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.514497 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.514285 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq9h6\" (UniqueName: \"kubernetes.io/projected/35a5e520-4d79-4b8a-9954-5ab6f67d5412-kube-api-access-rq9h6\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.514497 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.514308 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-run-systemd\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.514497 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.514329 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-etc-kubernetes\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.514497 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.514350 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-var-lib-openvswitch\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.514497 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.514374 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.514497 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.514396 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-multus-cni-dir\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.514497 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.514418 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-cnibin\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.514497 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.514440 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/79dd4fed-463d-4100-8267-e2165857f17d-hosts-file\") pod \"node-resolver-7gpxl\" (UID: \"79dd4fed-463d-4100-8267-e2165857f17d\") " pod="openshift-dns/node-resolver-7gpxl" Jul 15 14:30:42.514497 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.514462 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/085f819f-4469-41c0-8e1b-94b275ddac97-multus-daemon-config\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.514497 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.514483 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-slash\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.515223 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.514523 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8rr7\" (UniqueName: \"kubernetes.io/projected/29cee31f-448b-4475-ac84-e7778c196610-kube-api-access-m8rr7\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.532776 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.532752 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 14:30:42.571899 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.571874 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mbfzq" Jul 15 14:30:42.589391 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.589365 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mbfzq" Jul 15 14:30:42.598400 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.598375 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 14:30:42.615279 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615208 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-system-cni-dir\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.615279 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615245 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-hostroot\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.615279 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615270 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95033e7d-b1fc-4636-8587-0303f98e3ded-cnibin\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.615504 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615293 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-cni-bin\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.615504 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615318 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/29cee31f-448b-4475-ac84-e7778c196610-ovn-node-metrics-cert\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.615504 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615327 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-hostroot\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.615504 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615345 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-kubernetes\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.615504 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615364 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-cni-bin\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.615504 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615386 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-systemd\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.615504 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615387 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95033e7d-b1fc-4636-8587-0303f98e3ded-cnibin\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.615504 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615332 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-system-cni-dir\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.615504 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615410 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fld5c\" (UniqueName: \"kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c\") pod \"network-check-target-jv5jr\" (UID: \"5231db67-ee3e-41f3-9cc4-8819edeedb57\") " pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:30:42.615504 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615458 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-host-run-multus-certs\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.615504 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615487 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/29cee31f-448b-4475-ac84-e7778c196610-env-overrides\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.616063 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615512 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/29cee31f-448b-4475-ac84-e7778c196610-ovnkube-script-lib\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.616063 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615522 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-host-run-multus-certs\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.616063 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615538 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-sysconfig\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.616063 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615591 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-host-run-netns\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.616063 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615633 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-host-run-netns\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.616063 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615663 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-cni-netd\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.616063 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615701 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/29cee31f-448b-4475-ac84-e7778c196610-ovnkube-config\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.616063 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615734 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-sysctl-d\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.616063 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615778 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c22eb984-70ae-410e-ad51-48a3a55ce8f5-host-slash\") pod \"iptables-alerter-4kkr2\" (UID: \"c22eb984-70ae-410e-ad51-48a3a55ce8f5\") " pod="openshift-network-operator/iptables-alerter-4kkr2" Jul 15 14:30:42.616063 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615786 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-cni-netd\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.616063 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615821 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95033e7d-b1fc-4636-8587-0303f98e3ded-cni-binary-copy\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.616063 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.615914 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 14:30:42.616063 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616034 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/29cee31f-448b-4475-ac84-e7778c196610-env-overrides\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.616737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616089 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/35a5e520-4d79-4b8a-9954-5ab6f67d5412-socket-dir\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.616737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616151 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c22eb984-70ae-410e-ad51-48a3a55ce8f5-host-slash\") pod \"iptables-alerter-4kkr2\" (UID: \"c22eb984-70ae-410e-ad51-48a3a55ce8f5\") " pod="openshift-network-operator/iptables-alerter-4kkr2" Jul 15 14:30:42.616737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616186 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-run-netns\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.616737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616213 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-node-log\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.616737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616213 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/29cee31f-448b-4475-ac84-e7778c196610-ovnkube-script-lib\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.616737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616250 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-log-socket\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.616737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616282 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-modprobe-d\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.616737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616330 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkng8\" (UniqueName: \"kubernetes.io/projected/085f819f-4469-41c0-8e1b-94b275ddac97-kube-api-access-vkng8\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.616737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616363 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/35a5e520-4d79-4b8a-9954-5ab6f67d5412-socket-dir\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.616737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616364 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/29cee31f-448b-4475-ac84-e7778c196610-ovnkube-config\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.616737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616377 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95033e7d-b1fc-4636-8587-0303f98e3ded-cni-binary-copy\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.616737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616382 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95033e7d-b1fc-4636-8587-0303f98e3ded-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.616737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616386 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-node-log\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.616737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616409 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/35a5e520-4d79-4b8a-9954-5ab6f67d5412-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.616737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616421 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-run-netns\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.616737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616434 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-log-socket\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.616737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616456 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/35a5e520-4d79-4b8a-9954-5ab6f67d5412-etc-selinux\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.617454 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616481 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/35a5e520-4d79-4b8a-9954-5ab6f67d5412-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.617454 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616484 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-lib-modules\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.617454 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616520 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95033e7d-b1fc-4636-8587-0303f98e3ded-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.617454 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616516 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-host-var-lib-kubelet\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.617454 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616580 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/35a5e520-4d79-4b8a-9954-5ab6f67d5412-etc-selinux\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.617454 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616583 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95033e7d-b1fc-4636-8587-0303f98e3ded-system-cni-dir\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.617454 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616609 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-host-var-lib-kubelet\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.617454 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616621 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-kubelet\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.617454 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616619 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95033e7d-b1fc-4636-8587-0303f98e3ded-system-cni-dir\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.617454 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616646 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-run\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.617454 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616659 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-kubelet\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.617454 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616677 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qmc7\" (UniqueName: \"kubernetes.io/projected/5f454a34-849a-4a48-bd4f-845c5bf5c3c8-kube-api-access-2qmc7\") pod \"node-ca-f5t4p\" (UID: \"5f454a34-849a-4a48-bd4f-845c5bf5c3c8\") " pod="openshift-image-registry/node-ca-f5t4p" Jul 15 14:30:42.617454 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616703 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-run-ovn\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.617454 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616728 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79dd4fed-463d-4100-8267-e2165857f17d-tmp-dir\") pod \"node-resolver-7gpxl\" (UID: \"79dd4fed-463d-4100-8267-e2165857f17d\") " pod="openshift-dns/node-resolver-7gpxl" Jul 15 14:30:42.617454 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616737 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-run-ovn\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.617454 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616752 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-host-var-lib-cni-multus\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.617454 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616775 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-multus-conf-dir\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.618276 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616799 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95033e7d-b1fc-4636-8587-0303f98e3ded-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.618276 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616840 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/35a5e520-4d79-4b8a-9954-5ab6f67d5412-sys-fs\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.618276 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616848 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-host-var-lib-cni-multus\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.618276 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616863 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f1057e5f-10da-45d8-914f-2fec1ee7419b-dbus\") pod \"global-pull-secret-syncer-ddnm2\" (UID: \"f1057e5f-10da-45d8-914f-2fec1ee7419b\") " pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:42.618276 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616886 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-host-var-lib-cni-bin\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.618276 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616907 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f13d742-97fe-4e14-b5a2-bbda928c3c2f-agent-certs\") pod \"konnectivity-agent-wjj78\" (UID: \"6f13d742-97fe-4e14-b5a2-bbda928c3c2f\") " pod="kube-system/konnectivity-agent-wjj78" Jul 15 14:30:42.618276 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616930 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f1057e5f-10da-45d8-914f-2fec1ee7419b-kubelet-config\") pod \"global-pull-secret-syncer-ddnm2\" (UID: \"f1057e5f-10da-45d8-914f-2fec1ee7419b\") " pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:42.618276 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616951 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret\") pod \"global-pull-secret-syncer-ddnm2\" (UID: \"f1057e5f-10da-45d8-914f-2fec1ee7419b\") " pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:42.618276 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616974 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-sys\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.618276 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.616998 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c22eb984-70ae-410e-ad51-48a3a55ce8f5-iptables-alerter-script\") pod \"iptables-alerter-4kkr2\" (UID: \"c22eb984-70ae-410e-ad51-48a3a55ce8f5\") " pod="openshift-network-operator/iptables-alerter-4kkr2" Jul 15 14:30:42.618276 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617023 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85zw2\" (UniqueName: \"kubernetes.io/projected/c22eb984-70ae-410e-ad51-48a3a55ce8f5-kube-api-access-85zw2\") pod \"iptables-alerter-4kkr2\" (UID: \"c22eb984-70ae-410e-ad51-48a3a55ce8f5\") " pod="openshift-network-operator/iptables-alerter-4kkr2" Jul 15 14:30:42.618276 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617048 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95033e7d-b1fc-4636-8587-0303f98e3ded-os-release\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.618276 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617054 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79dd4fed-463d-4100-8267-e2165857f17d-tmp-dir\") pod \"node-resolver-7gpxl\" (UID: \"79dd4fed-463d-4100-8267-e2165857f17d\") " pod="openshift-dns/node-resolver-7gpxl" Jul 15 14:30:42.618276 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617073 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/35a5e520-4d79-4b8a-9954-5ab6f67d5412-registration-dir\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.618276 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617114 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-multus-conf-dir\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.618276 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617133 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/35a5e520-4d79-4b8a-9954-5ab6f67d5412-registration-dir\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.618276 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617143 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-sysctl-conf\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.619142 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617194 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/35a5e520-4d79-4b8a-9954-5ab6f67d5412-sys-fs\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.619142 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617215 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-tuned\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.619142 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617237 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95033e7d-b1fc-4636-8587-0303f98e3ded-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.619142 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617260 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-etc-openvswitch\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.619142 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617270 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95033e7d-b1fc-4636-8587-0303f98e3ded-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.619142 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617279 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-var-lib-kubelet\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.619142 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617298 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f454a34-849a-4a48-bd4f-845c5bf5c3c8-host\") pod \"node-ca-f5t4p\" (UID: \"5f454a34-849a-4a48-bd4f-845c5bf5c3c8\") " pod="openshift-image-registry/node-ca-f5t4p" Jul 15 14:30:42.619142 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617319 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/35a5e520-4d79-4b8a-9954-5ab6f67d5412-device-dir\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.619142 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617322 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f1057e5f-10da-45d8-914f-2fec1ee7419b-dbus\") pod \"global-pull-secret-syncer-ddnm2\" (UID: \"f1057e5f-10da-45d8-914f-2fec1ee7419b\") " pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:42.619142 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617324 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-host-var-lib-cni-bin\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.619142 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617347 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq9h6\" (UniqueName: \"kubernetes.io/projected/35a5e520-4d79-4b8a-9954-5ab6f67d5412-kube-api-access-rq9h6\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.619142 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617393 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-etc-openvswitch\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.619142 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:42.617458 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 14:30:42.619142 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:42.617561 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret podName:f1057e5f-10da-45d8-914f-2fec1ee7419b nodeName:}" failed. No retries permitted until 2026-07-15 14:30:43.117524973 +0000 UTC m=+2.990459527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret") pod "global-pull-secret-syncer-ddnm2" (UID: "f1057e5f-10da-45d8-914f-2fec1ee7419b") : object "kube-system"/"original-pull-secret" not registered Jul 15 14:30:42.619142 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617734 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95033e7d-b1fc-4636-8587-0303f98e3ded-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.619142 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617760 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f1057e5f-10da-45d8-914f-2fec1ee7419b-kubelet-config\") pod \"global-pull-secret-syncer-ddnm2\" (UID: \"f1057e5f-10da-45d8-914f-2fec1ee7419b\") " pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:42.619942 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617790 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-run-systemd\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.619942 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617864 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95033e7d-b1fc-4636-8587-0303f98e3ded-os-release\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.619942 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617914 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c22eb984-70ae-410e-ad51-48a3a55ce8f5-iptables-alerter-script\") pod \"iptables-alerter-4kkr2\" (UID: \"c22eb984-70ae-410e-ad51-48a3a55ce8f5\") " pod="openshift-network-operator/iptables-alerter-4kkr2" Jul 15 14:30:42.619942 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617915 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-host\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.619942 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617950 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-run-systemd\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.619942 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.617965 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/35a5e520-4d79-4b8a-9954-5ab6f67d5412-device-dir\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.619942 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618006 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-etc-kubernetes\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.619942 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618042 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-var-lib-openvswitch\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.619942 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618071 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-etc-kubernetes\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.619942 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618107 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.619942 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618123 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-var-lib-openvswitch\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.619942 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618167 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57298f9d-6f54-4d29-98bd-91ac59a92ff5-tmp\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.619942 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618191 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdx8l\" (UniqueName: \"kubernetes.io/projected/57298f9d-6f54-4d29-98bd-91ac59a92ff5-kube-api-access-fdx8l\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.619942 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618222 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-multus-cni-dir\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.619942 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618231 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.619942 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618247 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-cnibin\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.619942 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618270 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/79dd4fed-463d-4100-8267-e2165857f17d-hosts-file\") pod \"node-resolver-7gpxl\" (UID: \"79dd4fed-463d-4100-8267-e2165857f17d\") " pod="openshift-dns/node-resolver-7gpxl" Jul 15 14:30:42.620760 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618295 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/085f819f-4469-41c0-8e1b-94b275ddac97-multus-daemon-config\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.620760 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618296 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-multus-cni-dir\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.620760 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618338 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-cnibin\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.620760 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618341 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/79dd4fed-463d-4100-8267-e2165857f17d-hosts-file\") pod \"node-resolver-7gpxl\" (UID: \"79dd4fed-463d-4100-8267-e2165857f17d\") " pod="openshift-dns/node-resolver-7gpxl" Jul 15 14:30:42.620760 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618359 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-slash\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.620760 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618390 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-slash\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.620760 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618391 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8rr7\" (UniqueName: \"kubernetes.io/projected/29cee31f-448b-4475-ac84-e7778c196610-kube-api-access-m8rr7\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.620760 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618426 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs\") pod \"network-metrics-daemon-sn4mn\" (UID: \"081c09ac-5d7f-457e-b63a-354d4d4c793f\") " pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:42.620760 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618451 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/085f819f-4469-41c0-8e1b-94b275ddac97-cni-binary-copy\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.620760 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618484 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gt5r\" (UniqueName: \"kubernetes.io/projected/95033e7d-b1fc-4636-8587-0303f98e3ded-kube-api-access-7gt5r\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.620760 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618516 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-run-ovn-kubernetes\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.620760 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618559 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2hvb\" (UniqueName: \"kubernetes.io/projected/081c09ac-5d7f-457e-b63a-354d4d4c793f-kube-api-access-t2hvb\") pod \"network-metrics-daemon-sn4mn\" (UID: \"081c09ac-5d7f-457e-b63a-354d4d4c793f\") " pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:42.620760 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618583 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcqhw\" (UniqueName: \"kubernetes.io/projected/79dd4fed-463d-4100-8267-e2165857f17d-kube-api-access-tcqhw\") pod \"node-resolver-7gpxl\" (UID: \"79dd4fed-463d-4100-8267-e2165857f17d\") " pod="openshift-dns/node-resolver-7gpxl" Jul 15 14:30:42.620760 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618608 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-os-release\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.620760 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618611 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-host-run-ovn-kubernetes\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.620760 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618644 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-multus-socket-dir-parent\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.620760 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618669 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-os-release\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.620760 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618671 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-host-run-k8s-cni-cncf-io\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.621421 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618703 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-host-run-k8s-cni-cncf-io\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.621421 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618708 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f13d742-97fe-4e14-b5a2-bbda928c3c2f-konnectivity-ca\") pod \"konnectivity-agent-wjj78\" (UID: \"6f13d742-97fe-4e14-b5a2-bbda928c3c2f\") " pod="kube-system/konnectivity-agent-wjj78" Jul 15 14:30:42.621421 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618734 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-systemd-units\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.621421 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618749 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/085f819f-4469-41c0-8e1b-94b275ddac97-multus-socket-dir-parent\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.621421 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618759 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5f454a34-849a-4a48-bd4f-845c5bf5c3c8-serviceca\") pod \"node-ca-f5t4p\" (UID: \"5f454a34-849a-4a48-bd4f-845c5bf5c3c8\") " pod="openshift-image-registry/node-ca-f5t4p" Jul 15 14:30:42.621421 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618784 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-run-openvswitch\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.621421 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618867 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-run-openvswitch\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.621421 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618961 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/29cee31f-448b-4475-ac84-e7778c196610-systemd-units\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.621421 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.618977 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/085f819f-4469-41c0-8e1b-94b275ddac97-cni-binary-copy\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.621421 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:42.619031 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 14:30:42.621421 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:42.619085 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs podName:081c09ac-5d7f-457e-b63a-354d4d4c793f nodeName:}" failed. No retries permitted until 2026-07-15 14:30:43.119070638 +0000 UTC m=+2.992005191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs") pod "network-metrics-daemon-sn4mn" (UID: "081c09ac-5d7f-457e-b63a-354d4d4c793f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 14:30:42.621421 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.619360 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f13d742-97fe-4e14-b5a2-bbda928c3c2f-konnectivity-ca\") pod \"konnectivity-agent-wjj78\" (UID: \"6f13d742-97fe-4e14-b5a2-bbda928c3c2f\") " pod="kube-system/konnectivity-agent-wjj78" Jul 15 14:30:42.621421 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.619387 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/085f819f-4469-41c0-8e1b-94b275ddac97-multus-daemon-config\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.621421 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.620376 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/29cee31f-448b-4475-ac84-e7778c196610-ovn-node-metrics-cert\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.621421 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.620926 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f13d742-97fe-4e14-b5a2-bbda928c3c2f-agent-certs\") pod \"konnectivity-agent-wjj78\" (UID: \"6f13d742-97fe-4e14-b5a2-bbda928c3c2f\") " pod="kube-system/konnectivity-agent-wjj78" Jul 15 14:30:42.638453 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.638429 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkng8\" (UniqueName: \"kubernetes.io/projected/085f819f-4469-41c0-8e1b-94b275ddac97-kube-api-access-vkng8\") pod \"multus-4d7ml\" (UID: \"085f819f-4469-41c0-8e1b-94b275ddac97\") " pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.645996 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.645967 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gt5r\" (UniqueName: \"kubernetes.io/projected/95033e7d-b1fc-4636-8587-0303f98e3ded-kube-api-access-7gt5r\") pod \"multus-additional-cni-plugins-l4w7p\" (UID: \"95033e7d-b1fc-4636-8587-0303f98e3ded\") " pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.646432 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.646401 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcqhw\" (UniqueName: \"kubernetes.io/projected/79dd4fed-463d-4100-8267-e2165857f17d-kube-api-access-tcqhw\") pod \"node-resolver-7gpxl\" (UID: \"79dd4fed-463d-4100-8267-e2165857f17d\") " pod="openshift-dns/node-resolver-7gpxl" Jul 15 14:30:42.648243 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.647770 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8rr7\" (UniqueName: \"kubernetes.io/projected/29cee31f-448b-4475-ac84-e7778c196610-kube-api-access-m8rr7\") pod \"ovnkube-node-rqjt9\" (UID: \"29cee31f-448b-4475-ac84-e7778c196610\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.652862 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.652820 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq9h6\" (UniqueName: \"kubernetes.io/projected/35a5e520-4d79-4b8a-9954-5ab6f67d5412-kube-api-access-rq9h6\") pod \"aws-ebs-csi-driver-node-tvjsg\" (UID: \"35a5e520-4d79-4b8a-9954-5ab6f67d5412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.653713 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.653688 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2hvb\" (UniqueName: \"kubernetes.io/projected/081c09ac-5d7f-457e-b63a-354d4d4c793f-kube-api-access-t2hvb\") pod \"network-metrics-daemon-sn4mn\" (UID: \"081c09ac-5d7f-457e-b63a-354d4d4c793f\") " pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:42.654383 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.654362 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85zw2\" (UniqueName: \"kubernetes.io/projected/c22eb984-70ae-410e-ad51-48a3a55ce8f5-kube-api-access-85zw2\") pod \"iptables-alerter-4kkr2\" (UID: \"c22eb984-70ae-410e-ad51-48a3a55ce8f5\") " pod="openshift-network-operator/iptables-alerter-4kkr2" Jul 15 14:30:42.675740 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.675708 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" event={"ID":"27d6497d34fdf915d7c702237be63dc6","Type":"ContainerStarted","Data":"d59a11ae71f00fe58a8f03df7ce24938a27d582f4f55f008ded161efa205990e"} Jul 15 14:30:42.719757 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.719718 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-var-lib-kubelet\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.719757 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.719761 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f454a34-849a-4a48-bd4f-845c5bf5c3c8-host\") pod \"node-ca-f5t4p\" (UID: \"5f454a34-849a-4a48-bd4f-845c5bf5c3c8\") " pod="openshift-image-registry/node-ca-f5t4p" Jul 15 14:30:42.719979 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.719788 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-host\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.719979 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.719830 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57298f9d-6f54-4d29-98bd-91ac59a92ff5-tmp\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.719979 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.719853 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f454a34-849a-4a48-bd4f-845c5bf5c3c8-host\") pod \"node-ca-f5t4p\" (UID: \"5f454a34-849a-4a48-bd4f-845c5bf5c3c8\") " pod="openshift-image-registry/node-ca-f5t4p" Jul 15 14:30:42.719979 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.719872 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-var-lib-kubelet\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.719979 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.719860 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-host\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.719979 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.719856 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdx8l\" (UniqueName: \"kubernetes.io/projected/57298f9d-6f54-4d29-98bd-91ac59a92ff5-kube-api-access-fdx8l\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.720248 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.719998 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5f454a34-849a-4a48-bd4f-845c5bf5c3c8-serviceca\") pod \"node-ca-f5t4p\" (UID: \"5f454a34-849a-4a48-bd4f-845c5bf5c3c8\") " pod="openshift-image-registry/node-ca-f5t4p" Jul 15 14:30:42.720248 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720029 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-kubernetes\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.720248 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720052 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-systemd\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.720248 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720077 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fld5c\" (UniqueName: \"kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c\") pod \"network-check-target-jv5jr\" (UID: \"5231db67-ee3e-41f3-9cc4-8819edeedb57\") " pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:30:42.720248 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720105 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-sysconfig\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.720248 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720129 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-sysctl-d\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.720248 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720133 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-kubernetes\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.720248 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720157 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-modprobe-d\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.720248 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720186 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-lib-modules\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.720248 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720212 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-run\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.720248 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720223 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-systemd\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.720819 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720234 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qmc7\" (UniqueName: \"kubernetes.io/projected/5f454a34-849a-4a48-bd4f-845c5bf5c3c8-kube-api-access-2qmc7\") pod \"node-ca-f5t4p\" (UID: \"5f454a34-849a-4a48-bd4f-845c5bf5c3c8\") " pod="openshift-image-registry/node-ca-f5t4p" Jul 15 14:30:42.720819 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720320 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-sys\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.720819 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720349 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-sysctl-conf\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.720819 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720371 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-tuned\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.720819 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720419 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-modprobe-d\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.720819 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720466 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-sysconfig\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.720819 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720510 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5f454a34-849a-4a48-bd4f-845c5bf5c3c8-serviceca\") pod \"node-ca-f5t4p\" (UID: \"5f454a34-849a-4a48-bd4f-845c5bf5c3c8\") " pod="openshift-image-registry/node-ca-f5t4p" Jul 15 14:30:42.720819 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720548 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-sysctl-d\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.720819 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720554 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-lib-modules\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.720819 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720591 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-run\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.720819 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720593 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-sys\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.720819 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.720646 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-sysctl-conf\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.722574 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.722551 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57298f9d-6f54-4d29-98bd-91ac59a92ff5-tmp\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.722679 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.722639 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/57298f9d-6f54-4d29-98bd-91ac59a92ff5-etc-tuned\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.741801 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:42.741772 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 14:30:42.741801 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:42.741801 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 14:30:42.741982 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:42.741829 2565 projected.go:196] Error preparing data for projected volume kube-api-access-fld5c for pod openshift-network-diagnostics/network-check-target-jv5jr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 14:30:42.741982 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:42.741897 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c podName:5231db67-ee3e-41f3-9cc4-8819edeedb57 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:43.241875919 +0000 UTC m=+3.114810457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fld5c" (UniqueName: "kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c") pod "network-check-target-jv5jr" (UID: "5231db67-ee3e-41f3-9cc4-8819edeedb57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 14:30:42.746208 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.746185 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdx8l\" (UniqueName: \"kubernetes.io/projected/57298f9d-6f54-4d29-98bd-91ac59a92ff5-kube-api-access-fdx8l\") pod \"tuned-zvx9h\" (UID: \"57298f9d-6f54-4d29-98bd-91ac59a92ff5\") " pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.748265 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.748244 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qmc7\" (UniqueName: \"kubernetes.io/projected/5f454a34-849a-4a48-bd4f-845c5bf5c3c8-kube-api-access-2qmc7\") pod \"node-ca-f5t4p\" (UID: \"5f454a34-849a-4a48-bd4f-845c5bf5c3c8\") " pod="openshift-image-registry/node-ca-f5t4p" Jul 15 14:30:42.801092 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.801059 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4kkr2" Jul 15 14:30:42.808173 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.808150 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:30:42.818892 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.818870 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7gpxl" Jul 15 14:30:42.824687 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.824664 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4d7ml" Jul 15 14:30:42.832346 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.832330 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l4w7p" Jul 15 14:30:42.840835 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.840676 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" Jul 15 14:30:42.853702 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.853674 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wjj78" Jul 15 14:30:42.862026 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.862007 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" Jul 15 14:30:42.868682 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:42.868628 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f5t4p" Jul 15 14:30:43.124911 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:43.124822 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret\") pod \"global-pull-secret-syncer-ddnm2\" (UID: \"f1057e5f-10da-45d8-914f-2fec1ee7419b\") " pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:43.124911 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:43.124903 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs\") pod \"network-metrics-daemon-sn4mn\" (UID: \"081c09ac-5d7f-457e-b63a-354d4d4c793f\") " pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:43.125131 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:43.124946 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 14:30:43.125131 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:43.125018 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret podName:f1057e5f-10da-45d8-914f-2fec1ee7419b nodeName:}" failed. No retries permitted until 2026-07-15 14:30:44.124997531 +0000 UTC m=+3.997932069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret") pod "global-pull-secret-syncer-ddnm2" (UID: "f1057e5f-10da-45d8-914f-2fec1ee7419b") : object "kube-system"/"original-pull-secret" not registered Jul 15 14:30:43.125131 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:43.125045 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 14:30:43.125131 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:43.125104 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs podName:081c09ac-5d7f-457e-b63a-354d4d4c793f nodeName:}" failed. No retries permitted until 2026-07-15 14:30:44.125087733 +0000 UTC m=+3.998022272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs") pod "network-metrics-daemon-sn4mn" (UID: "081c09ac-5d7f-457e-b63a-354d4d4c793f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 14:30:43.326568 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:43.326537 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fld5c\" (UniqueName: \"kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c\") pod \"network-check-target-jv5jr\" (UID: \"5231db67-ee3e-41f3-9cc4-8819edeedb57\") " pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:30:43.326725 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:43.326705 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 14:30:43.326764 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:43.326732 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 14:30:43.326802 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:43.326765 2565 projected.go:196] Error preparing data for projected volume kube-api-access-fld5c for pod openshift-network-diagnostics/network-check-target-jv5jr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 14:30:43.326802 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:43.326848 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c podName:5231db67-ee3e-41f3-9cc4-8819edeedb57 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:44.326827981 +0000 UTC m=+4.199762521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fld5c" (UniqueName: "kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c") pod "network-check-target-jv5jr" (UID: "5231db67-ee3e-41f3-9cc4-8819edeedb57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 14:30:43.591532 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:43.591433 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 14:25:42 +0000 UTC" deadline="2028-04-25 06:45:21.838701546 +0000 UTC" Jul 15 14:30:43.591532 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:43.591472 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15592h14m38.247232802s" Jul 15 14:30:43.671716 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:43.671123 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:43.671716 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:43.671260 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sn4mn" podUID="081c09ac-5d7f-457e-b63a-354d4d4c793f" Jul 15 14:30:43.671716 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:43.671303 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:30:43.671716 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:43.671412 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jv5jr" podUID="5231db67-ee3e-41f3-9cc4-8819edeedb57" Jul 15 14:30:43.672302 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:43.672188 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79dd4fed_463d_4100_8267_e2165857f17d.slice/crio-379eec16b63b2ca4a456e53876e04db059f1f73e0bd6a596f84eac07a544f938 WatchSource:0}: Error finding container 379eec16b63b2ca4a456e53876e04db059f1f73e0bd6a596f84eac07a544f938: Status 404 returned error can't find the container with id 379eec16b63b2ca4a456e53876e04db059f1f73e0bd6a596f84eac07a544f938 Jul 15 14:30:43.673000 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:43.672970 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95033e7d_b1fc_4636_8587_0303f98e3ded.slice/crio-ca20328aa590c535c29572490d50617928743a34bbe4b444bfb99c5e09587b51 WatchSource:0}: Error finding container ca20328aa590c535c29572490d50617928743a34bbe4b444bfb99c5e09587b51: Status 404 returned error can't find the container with id ca20328aa590c535c29572490d50617928743a34bbe4b444bfb99c5e09587b51 Jul 15 14:30:43.675938 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:43.675392 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29cee31f_448b_4475_ac84_e7778c196610.slice/crio-32cf63779afd0ac5c619b61df25ddd7667f55c66460b24f7392f1c41c686ad70 WatchSource:0}: Error finding container 32cf63779afd0ac5c619b61df25ddd7667f55c66460b24f7392f1c41c686ad70: Status 404 returned error can't find the container with id 32cf63779afd0ac5c619b61df25ddd7667f55c66460b24f7392f1c41c686ad70 Jul 15 14:30:43.681640 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:43.681617 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f13d742_97fe_4e14_b5a2_bbda928c3c2f.slice/crio-844302941fd47ac288dc74e5d5cd1cad4b7ff57b8a4043074484b3c2eb8ce4c4 WatchSource:0}: Error finding container 844302941fd47ac288dc74e5d5cd1cad4b7ff57b8a4043074484b3c2eb8ce4c4: Status 404 returned error can't find the container with id 844302941fd47ac288dc74e5d5cd1cad4b7ff57b8a4043074484b3c2eb8ce4c4 Jul 15 14:30:43.682241 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:43.682136 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" event={"ID":"57298f9d-6f54-4d29-98bd-91ac59a92ff5","Type":"ContainerStarted","Data":"e106c59d8d4e0f35e5a9a6b105745fdac3f6a3014ad492885eae318178bfc2ee"} Jul 15 14:30:43.683643 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:43.683601 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod085f819f_4469_41c0_8e1b_94b275ddac97.slice/crio-eb91c7cef8a0796ac925228c67c4c86c41ff8956bf22cd5c07bed8baff8c3ae8 WatchSource:0}: Error finding container eb91c7cef8a0796ac925228c67c4c86c41ff8956bf22cd5c07bed8baff8c3ae8: Status 404 returned error can't find the container with id eb91c7cef8a0796ac925228c67c4c86c41ff8956bf22cd5c07bed8baff8c3ae8 Jul 15 14:30:43.684363 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:43.684163 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" event={"ID":"29cee31f-448b-4475-ac84-e7778c196610","Type":"ContainerStarted","Data":"32cf63779afd0ac5c619b61df25ddd7667f55c66460b24f7392f1c41c686ad70"} Jul 15 14:30:43.684455 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:43.684437 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22eb984_70ae_410e_ad51_48a3a55ce8f5.slice/crio-55d5850d78a2d61e3c600f0cf40da5fa32443d686939804ca1409266c326e8a6 WatchSource:0}: Error finding container 55d5850d78a2d61e3c600f0cf40da5fa32443d686939804ca1409266c326e8a6: Status 404 returned error can't find the container with id 55d5850d78a2d61e3c600f0cf40da5fa32443d686939804ca1409266c326e8a6 Jul 15 14:30:43.687193 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:43.686645 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f454a34_849a_4a48_bd4f_845c5bf5c3c8.slice/crio-caf7266c18ce576225c51007566494655861c21d6f941f66f568438aecd3ee49 WatchSource:0}: Error finding container caf7266c18ce576225c51007566494655861c21d6f941f66f568438aecd3ee49: Status 404 returned error can't find the container with id caf7266c18ce576225c51007566494655861c21d6f941f66f568438aecd3ee49 Jul 15 14:30:43.687193 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:30:43.687117 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35a5e520_4d79_4b8a_9954_5ab6f67d5412.slice/crio-3ff1f7b70382c07fd1c36be6a2c163c42c1173dea87feee6ead9f99ad22de4b6 WatchSource:0}: Error finding container 3ff1f7b70382c07fd1c36be6a2c163c42c1173dea87feee6ead9f99ad22de4b6: Status 404 returned error can't find the container with id 3ff1f7b70382c07fd1c36be6a2c163c42c1173dea87feee6ead9f99ad22de4b6 Jul 15 14:30:43.688044 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:43.687647 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4w7p" event={"ID":"95033e7d-b1fc-4636-8587-0303f98e3ded","Type":"ContainerStarted","Data":"ca20328aa590c535c29572490d50617928743a34bbe4b444bfb99c5e09587b51"} Jul 15 14:30:43.688758 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:43.688736 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7gpxl" event={"ID":"79dd4fed-463d-4100-8267-e2165857f17d","Type":"ContainerStarted","Data":"379eec16b63b2ca4a456e53876e04db059f1f73e0bd6a596f84eac07a544f938"} Jul 15 14:30:44.132457 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:44.132164 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret\") pod \"global-pull-secret-syncer-ddnm2\" (UID: \"f1057e5f-10da-45d8-914f-2fec1ee7419b\") " pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:44.132650 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:44.132454 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs\") pod \"network-metrics-daemon-sn4mn\" (UID: \"081c09ac-5d7f-457e-b63a-354d4d4c793f\") " pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:44.132650 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:44.132583 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 14:30:44.132650 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:44.132649 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs podName:081c09ac-5d7f-457e-b63a-354d4d4c793f nodeName:}" failed. No retries permitted until 2026-07-15 14:30:46.132629428 +0000 UTC m=+6.005563969 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs") pod "network-metrics-daemon-sn4mn" (UID: "081c09ac-5d7f-457e-b63a-354d4d4c793f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 14:30:44.133189 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:44.133088 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 14:30:44.133189 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:44.133143 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret podName:f1057e5f-10da-45d8-914f-2fec1ee7419b nodeName:}" failed. No retries permitted until 2026-07-15 14:30:46.13312736 +0000 UTC m=+6.006061913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret") pod "global-pull-secret-syncer-ddnm2" (UID: "f1057e5f-10da-45d8-914f-2fec1ee7419b") : object "kube-system"/"original-pull-secret" not registered Jul 15 14:30:44.334525 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:44.334487 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fld5c\" (UniqueName: \"kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c\") pod \"network-check-target-jv5jr\" (UID: \"5231db67-ee3e-41f3-9cc4-8819edeedb57\") " pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:30:44.334695 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:44.334682 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 14:30:44.334769 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:44.334704 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 14:30:44.334769 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:44.334716 2565 projected.go:196] Error preparing data for projected volume kube-api-access-fld5c for pod openshift-network-diagnostics/network-check-target-jv5jr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 14:30:44.334897 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:44.334772 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c podName:5231db67-ee3e-41f3-9cc4-8819edeedb57 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:46.334752967 +0000 UTC m=+6.207687524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fld5c" (UniqueName: "kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c") pod "network-check-target-jv5jr" (UID: "5231db67-ee3e-41f3-9cc4-8819edeedb57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 14:30:44.592339 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:44.592223 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 14:25:42 +0000 UTC" deadline="2027-12-25 01:18:52.015059839 +0000 UTC" Jul 15 14:30:44.592339 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:44.592287 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12658h48m7.422776393s" Jul 15 14:30:44.672999 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:44.672971 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:44.673168 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:44.673106 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddnm2" podUID="f1057e5f-10da-45d8-914f-2fec1ee7419b" Jul 15 14:30:44.707960 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:44.707923 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wjj78" event={"ID":"6f13d742-97fe-4e14-b5a2-bbda928c3c2f","Type":"ContainerStarted","Data":"844302941fd47ac288dc74e5d5cd1cad4b7ff57b8a4043074484b3c2eb8ce4c4"} Jul 15 14:30:44.723732 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:44.723700 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" event={"ID":"f671eeaf614c8d693fab4bd5bb741bfd","Type":"ContainerStarted","Data":"6052b5f95bb8003c931fc7f4c024c05ff0ed3e98485ada31229a6ba948ca8fe7"} Jul 15 14:30:44.740034 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:44.739996 2565 generic.go:356] "Generic (PLEG): container finished" podID="27d6497d34fdf915d7c702237be63dc6" containerID="939f1d0b7013c6acd330decc7afe7ffff3bb015d99bd4feaf9c1c7e431d19d1a" exitCode=0 Jul 15 14:30:44.740283 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:44.740259 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" event={"ID":"27d6497d34fdf915d7c702237be63dc6","Type":"ContainerDied","Data":"939f1d0b7013c6acd330decc7afe7ffff3bb015d99bd4feaf9c1c7e431d19d1a"} Jul 15 14:30:44.745261 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:44.745214 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" podStartSLOduration=3.745192685 podStartE2EDuration="3.745192685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:30:44.744180418 +0000 UTC m=+4.617114979" watchObservedRunningTime="2026-07-15 14:30:44.745192685 +0000 UTC m=+4.618127260" Jul 15 14:30:44.778637 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:44.778544 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f5t4p" event={"ID":"5f454a34-849a-4a48-bd4f-845c5bf5c3c8","Type":"ContainerStarted","Data":"caf7266c18ce576225c51007566494655861c21d6f941f66f568438aecd3ee49"} Jul 15 14:30:44.790568 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:44.790456 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4kkr2" event={"ID":"c22eb984-70ae-410e-ad51-48a3a55ce8f5","Type":"ContainerStarted","Data":"55d5850d78a2d61e3c600f0cf40da5fa32443d686939804ca1409266c326e8a6"} Jul 15 14:30:44.811228 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:44.811122 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" event={"ID":"35a5e520-4d79-4b8a-9954-5ab6f67d5412","Type":"ContainerStarted","Data":"3ff1f7b70382c07fd1c36be6a2c163c42c1173dea87feee6ead9f99ad22de4b6"} Jul 15 14:30:44.821111 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:44.821024 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4d7ml" event={"ID":"085f819f-4469-41c0-8e1b-94b275ddac97","Type":"ContainerStarted","Data":"eb91c7cef8a0796ac925228c67c4c86c41ff8956bf22cd5c07bed8baff8c3ae8"} Jul 15 14:30:45.671567 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:45.671528 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:45.672297 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:45.671692 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sn4mn" podUID="081c09ac-5d7f-457e-b63a-354d4d4c793f" Jul 15 14:30:45.672297 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:45.672146 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:30:45.672297 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:45.672239 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jv5jr" podUID="5231db67-ee3e-41f3-9cc4-8819edeedb57" Jul 15 14:30:45.861184 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:45.861151 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" event={"ID":"27d6497d34fdf915d7c702237be63dc6","Type":"ContainerStarted","Data":"f9afdb006858ce7577bfcc55f4865d4aab5c8b95f844b412ad860a021c23f973"} Jul 15 14:30:46.149434 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:46.149201 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret\") pod \"global-pull-secret-syncer-ddnm2\" (UID: \"f1057e5f-10da-45d8-914f-2fec1ee7419b\") " pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:46.149434 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:46.149272 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs\") pod \"network-metrics-daemon-sn4mn\" (UID: \"081c09ac-5d7f-457e-b63a-354d4d4c793f\") " pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:46.149434 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:46.149392 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 14:30:46.149719 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:46.149455 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs podName:081c09ac-5d7f-457e-b63a-354d4d4c793f nodeName:}" failed. No retries permitted until 2026-07-15 14:30:50.149436517 +0000 UTC m=+10.022371057 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs") pod "network-metrics-daemon-sn4mn" (UID: "081c09ac-5d7f-457e-b63a-354d4d4c793f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 14:30:46.149719 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:46.149476 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 14:30:46.149719 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:46.149549 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret podName:f1057e5f-10da-45d8-914f-2fec1ee7419b nodeName:}" failed. No retries permitted until 2026-07-15 14:30:50.149529185 +0000 UTC m=+10.022463729 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret") pod "global-pull-secret-syncer-ddnm2" (UID: "f1057e5f-10da-45d8-914f-2fec1ee7419b") : object "kube-system"/"original-pull-secret" not registered Jul 15 14:30:46.351877 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:46.351832 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fld5c\" (UniqueName: \"kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c\") pod \"network-check-target-jv5jr\" (UID: \"5231db67-ee3e-41f3-9cc4-8819edeedb57\") " pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:30:46.352068 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:46.352025 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 14:30:46.352068 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:46.352045 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 14:30:46.352068 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:46.352057 2565 projected.go:196] Error preparing data for projected volume kube-api-access-fld5c for pod openshift-network-diagnostics/network-check-target-jv5jr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 14:30:46.352237 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:46.352111 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c podName:5231db67-ee3e-41f3-9cc4-8819edeedb57 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:50.352093058 +0000 UTC m=+10.225027616 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fld5c" (UniqueName: "kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c") pod "network-check-target-jv5jr" (UID: "5231db67-ee3e-41f3-9cc4-8819edeedb57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 14:30:46.671531 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:46.671221 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:46.671531 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:46.671370 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddnm2" podUID="f1057e5f-10da-45d8-914f-2fec1ee7419b" Jul 15 14:30:47.676177 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:47.671228 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:30:47.676177 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:47.671276 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:47.676177 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:47.671351 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jv5jr" podUID="5231db67-ee3e-41f3-9cc4-8819edeedb57" Jul 15 14:30:47.676177 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:47.671550 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sn4mn" podUID="081c09ac-5d7f-457e-b63a-354d4d4c793f" Jul 15 14:30:48.674713 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:48.674688 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:48.674910 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:48.674842 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddnm2" podUID="f1057e5f-10da-45d8-914f-2fec1ee7419b" Jul 15 14:30:49.671424 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:49.671391 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:49.671424 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:49.671411 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:30:49.671944 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:49.671534 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sn4mn" podUID="081c09ac-5d7f-457e-b63a-354d4d4c793f" Jul 15 14:30:49.671944 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:49.671669 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jv5jr" podUID="5231db67-ee3e-41f3-9cc4-8819edeedb57" Jul 15 14:30:50.187763 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:50.187723 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret\") pod \"global-pull-secret-syncer-ddnm2\" (UID: \"f1057e5f-10da-45d8-914f-2fec1ee7419b\") " pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:50.187975 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:50.187791 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs\") pod \"network-metrics-daemon-sn4mn\" (UID: \"081c09ac-5d7f-457e-b63a-354d4d4c793f\") " pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:50.187975 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:50.187939 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 14:30:50.188091 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:50.188008 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs podName:081c09ac-5d7f-457e-b63a-354d4d4c793f nodeName:}" failed. No retries permitted until 2026-07-15 14:30:58.187988939 +0000 UTC m=+18.060923483 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs") pod "network-metrics-daemon-sn4mn" (UID: "081c09ac-5d7f-457e-b63a-354d4d4c793f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 14:30:50.188091 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:50.187939 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 14:30:50.188204 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:50.188096 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret podName:f1057e5f-10da-45d8-914f-2fec1ee7419b nodeName:}" failed. No retries permitted until 2026-07-15 14:30:58.188073732 +0000 UTC m=+18.061008285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret") pod "global-pull-secret-syncer-ddnm2" (UID: "f1057e5f-10da-45d8-914f-2fec1ee7419b") : object "kube-system"/"original-pull-secret" not registered Jul 15 14:30:50.390195 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:50.389716 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fld5c\" (UniqueName: \"kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c\") pod \"network-check-target-jv5jr\" (UID: \"5231db67-ee3e-41f3-9cc4-8819edeedb57\") " pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:30:50.390195 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:50.389977 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 14:30:50.390195 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:50.390003 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 14:30:50.390195 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:50.390018 2565 projected.go:196] Error preparing data for projected volume kube-api-access-fld5c for pod openshift-network-diagnostics/network-check-target-jv5jr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 14:30:50.390195 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:50.390086 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c podName:5231db67-ee3e-41f3-9cc4-8819edeedb57 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:58.390067233 +0000 UTC m=+18.263001773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fld5c" (UniqueName: "kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c") pod "network-check-target-jv5jr" (UID: "5231db67-ee3e-41f3-9cc4-8819edeedb57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 14:30:50.674589 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:50.674164 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:50.674589 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:50.674280 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddnm2" podUID="f1057e5f-10da-45d8-914f-2fec1ee7419b" Jul 15 14:30:51.671610 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:51.671577 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:51.671776 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:51.671729 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sn4mn" podUID="081c09ac-5d7f-457e-b63a-354d4d4c793f" Jul 15 14:30:51.671871 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:51.671791 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:30:51.671922 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:51.671885 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jv5jr" podUID="5231db67-ee3e-41f3-9cc4-8819edeedb57" Jul 15 14:30:52.670685 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:52.670647 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:52.671213 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:52.670782 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddnm2" podUID="f1057e5f-10da-45d8-914f-2fec1ee7419b" Jul 15 14:30:53.671006 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:53.670965 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:53.671006 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:53.670998 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:30:53.671452 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:53.671091 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sn4mn" podUID="081c09ac-5d7f-457e-b63a-354d4d4c793f" Jul 15 14:30:53.671452 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:53.671209 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jv5jr" podUID="5231db67-ee3e-41f3-9cc4-8819edeedb57" Jul 15 14:30:54.670895 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:54.670861 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:54.671076 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:54.671002 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddnm2" podUID="f1057e5f-10da-45d8-914f-2fec1ee7419b" Jul 15 14:30:55.671144 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:55.671106 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:55.671144 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:55.671147 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:30:55.671652 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:55.671261 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sn4mn" podUID="081c09ac-5d7f-457e-b63a-354d4d4c793f" Jul 15 14:30:55.671652 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:55.671409 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jv5jr" podUID="5231db67-ee3e-41f3-9cc4-8819edeedb57" Jul 15 14:30:56.671666 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:56.671621 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:56.672108 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:56.671787 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddnm2" podUID="f1057e5f-10da-45d8-914f-2fec1ee7419b" Jul 15 14:30:57.671361 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:57.671325 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:57.671595 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:57.671325 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:30:57.671595 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:57.671463 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sn4mn" podUID="081c09ac-5d7f-457e-b63a-354d4d4c793f" Jul 15 14:30:57.671595 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:57.671498 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jv5jr" podUID="5231db67-ee3e-41f3-9cc4-8819edeedb57" Jul 15 14:30:58.251728 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:58.251693 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs\") pod \"network-metrics-daemon-sn4mn\" (UID: \"081c09ac-5d7f-457e-b63a-354d4d4c793f\") " pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:58.252171 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:58.251790 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret\") pod \"global-pull-secret-syncer-ddnm2\" (UID: \"f1057e5f-10da-45d8-914f-2fec1ee7419b\") " pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:58.252171 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:58.251870 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 14:30:58.252171 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:58.251902 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 14:30:58.252171 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:58.251946 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs podName:081c09ac-5d7f-457e-b63a-354d4d4c793f nodeName:}" failed. No retries permitted until 2026-07-15 14:31:14.251928849 +0000 UTC m=+34.124863387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs") pod "network-metrics-daemon-sn4mn" (UID: "081c09ac-5d7f-457e-b63a-354d4d4c793f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 14:30:58.252171 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:58.251960 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret podName:f1057e5f-10da-45d8-914f-2fec1ee7419b nodeName:}" failed. No retries permitted until 2026-07-15 14:31:14.251954268 +0000 UTC m=+34.124888806 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret") pod "global-pull-secret-syncer-ddnm2" (UID: "f1057e5f-10da-45d8-914f-2fec1ee7419b") : object "kube-system"/"original-pull-secret" not registered Jul 15 14:30:58.453279 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:58.453239 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fld5c\" (UniqueName: \"kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c\") pod \"network-check-target-jv5jr\" (UID: \"5231db67-ee3e-41f3-9cc4-8819edeedb57\") " pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:30:58.453477 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:58.453450 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 14:30:58.453477 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:58.453475 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 14:30:58.453593 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:58.453495 2565 projected.go:196] Error preparing data for projected volume kube-api-access-fld5c for pod openshift-network-diagnostics/network-check-target-jv5jr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 14:30:58.453593 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:58.453557 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c podName:5231db67-ee3e-41f3-9cc4-8819edeedb57 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:14.45354253 +0000 UTC m=+34.326477081 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fld5c" (UniqueName: "kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c") pod "network-check-target-jv5jr" (UID: "5231db67-ee3e-41f3-9cc4-8819edeedb57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 14:30:58.671406 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:58.671375 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:30:58.671593 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:58.671483 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddnm2" podUID="f1057e5f-10da-45d8-914f-2fec1ee7419b" Jul 15 14:30:59.670750 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:59.670713 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:30:59.671186 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:30:59.670713 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:30:59.671186 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:59.670886 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sn4mn" podUID="081c09ac-5d7f-457e-b63a-354d4d4c793f" Jul 15 14:30:59.671186 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:30:59.670988 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jv5jr" podUID="5231db67-ee3e-41f3-9cc4-8819edeedb57" Jul 15 14:31:00.673836 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:00.673793 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:31:00.674290 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:00.673922 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddnm2" podUID="f1057e5f-10da-45d8-914f-2fec1ee7419b" Jul 15 14:31:01.670992 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:01.670955 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:31:01.671181 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:01.670976 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:31:01.671181 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:01.671109 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sn4mn" podUID="081c09ac-5d7f-457e-b63a-354d4d4c793f" Jul 15 14:31:01.671181 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:01.671136 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jv5jr" podUID="5231db67-ee3e-41f3-9cc4-8819edeedb57" Jul 15 14:31:02.674645 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:02.674337 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:31:02.675238 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:02.674725 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddnm2" podUID="f1057e5f-10da-45d8-914f-2fec1ee7419b" Jul 15 14:31:02.898781 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:02.898737 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" event={"ID":"35a5e520-4d79-4b8a-9954-5ab6f67d5412","Type":"ContainerStarted","Data":"748362d637c40cd1d62adc512681bc5a63bd65471f33843bb2e407a7ed824c41"} Jul 15 14:31:02.900367 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:02.900336 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4d7ml" event={"ID":"085f819f-4469-41c0-8e1b-94b275ddac97","Type":"ContainerStarted","Data":"c1dcf622da855f45a28d7ed3e2cf0594cd2264413575f8b0d03318f964471e4b"} Jul 15 14:31:02.903461 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:02.903432 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" event={"ID":"29cee31f-448b-4475-ac84-e7778c196610","Type":"ContainerStarted","Data":"f95f472690fda069aeacdcf7d5b78c27743a88f7b59c6419328e0baec3d19a33"} Jul 15 14:31:02.903601 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:02.903505 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" event={"ID":"29cee31f-448b-4475-ac84-e7778c196610","Type":"ContainerStarted","Data":"51e21ae30d8ed21a8cbed6bb3f43da2a8b9466252e7daf6bb45341e3f0c3d1f6"} Jul 15 14:31:02.903601 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:02.903551 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" event={"ID":"29cee31f-448b-4475-ac84-e7778c196610","Type":"ContainerStarted","Data":"5e4e3292b34a72adc136c7f48d74451a34bb25db84fe7dc9df77f35320686fe8"} Jul 15 14:31:02.903712 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:02.903600 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" event={"ID":"29cee31f-448b-4475-ac84-e7778c196610","Type":"ContainerStarted","Data":"87322190d307913f68c341cb994f7eb6a4b56f557e68faf8c42e7ce6f4e65c94"} Jul 15 14:31:02.903712 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:02.903671 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" event={"ID":"29cee31f-448b-4475-ac84-e7778c196610","Type":"ContainerStarted","Data":"ab1870d2593f2ea207bdb62d4e495082ecbed9af6351f0169c43d34e6ce43c7f"} Jul 15 14:31:02.905317 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:02.905291 2565 generic.go:356] "Generic (PLEG): container finished" podID="95033e7d-b1fc-4636-8587-0303f98e3ded" containerID="8ceb60b3d65066b054d2fc45397c6475f391f5feea6b3e5ed3470f5e25d29c1c" exitCode=0 Jul 15 14:31:02.905433 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:02.905375 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4w7p" event={"ID":"95033e7d-b1fc-4636-8587-0303f98e3ded","Type":"ContainerDied","Data":"8ceb60b3d65066b054d2fc45397c6475f391f5feea6b3e5ed3470f5e25d29c1c"} Jul 15 14:31:02.907047 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:02.907018 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7gpxl" event={"ID":"79dd4fed-463d-4100-8267-e2165857f17d","Type":"ContainerStarted","Data":"73c67f4e71af9ec57e4fb97454506738779f4984e152d34aac77aefc804f5f95"} Jul 15 14:31:02.908550 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:02.908524 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wjj78" event={"ID":"6f13d742-97fe-4e14-b5a2-bbda928c3c2f","Type":"ContainerStarted","Data":"3863c3a826a96cd473d536b6cff7289f915aa619b77fc6c7a050c50ce12d50d1"} Jul 15 14:31:02.910103 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:02.910051 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" event={"ID":"57298f9d-6f54-4d29-98bd-91ac59a92ff5","Type":"ContainerStarted","Data":"ba5de008d2aebe64efba2fe31f037d483d55db1cf5968b72ded8355fdf94eec5"} Jul 15 14:31:02.911580 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:02.911557 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f5t4p" event={"ID":"5f454a34-849a-4a48-bd4f-845c5bf5c3c8","Type":"ContainerStarted","Data":"fc1d52ae1428b9945931dbcae87c33efef4a9ba970e854171acf6423416166cf"} Jul 15 14:31:02.918772 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:02.918712 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" podStartSLOduration=21.918694896 podStartE2EDuration="21.918694896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:30:45.879514536 +0000 UTC m=+5.752449097" watchObservedRunningTime="2026-07-15 14:31:02.918694896 +0000 UTC m=+22.791629457" Jul 15 14:31:02.919249 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:02.919220 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4d7ml" podStartSLOduration=4.353580258 podStartE2EDuration="22.919210024s" totalImagesPullingTime="18.565629766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:02.918405496 +0000 UTC m=+22.791340057" watchObservedRunningTime="2026-07-15 14:31:02.919210024 +0000 UTC m=+22.792144586" Jul 15 14:31:02.968660 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:02.968168 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wjj78" podStartSLOduration=12.512575229 podStartE2EDuration="22.968149576s" totalImagesPullingTime="10.455574347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:02.967583576 +0000 UTC m=+22.840518160" watchObservedRunningTime="2026-07-15 14:31:02.968149576 +0000 UTC m=+22.841084133" Jul 15 14:31:02.987471 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:02.987412 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7gpxl" podStartSLOduration=4.460427275 podStartE2EDuration="22.987391796s" totalImagesPullingTime="18.526964521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:02.986782048 +0000 UTC m=+22.859716610" watchObservedRunningTime="2026-07-15 14:31:02.987391796 +0000 UTC m=+22.860326357" Jul 15 14:31:03.009474 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:03.009417 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zvx9h" podStartSLOduration=4.486127124 podStartE2EDuration="23.009400951s" totalImagesPullingTime="18.523273827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:03.008953962 +0000 UTC m=+22.881888512" watchObservedRunningTime="2026-07-15 14:31:03.009400951 +0000 UTC m=+22.882335510" Jul 15 14:31:03.027356 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:03.027310 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f5t4p" podStartSLOduration=4.511170805 podStartE2EDuration="23.027293929s" totalImagesPullingTime="18.516123124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:03.026928955 +0000 UTC m=+22.899863515" watchObservedRunningTime="2026-07-15 14:31:03.027293929 +0000 UTC m=+22.900228490" Jul 15 14:31:03.671388 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:03.671357 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:31:03.671560 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:03.671402 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:31:03.671560 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:03.671474 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sn4mn" podUID="081c09ac-5d7f-457e-b63a-354d4d4c793f" Jul 15 14:31:03.671639 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:03.671581 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jv5jr" podUID="5231db67-ee3e-41f3-9cc4-8819edeedb57" Jul 15 14:31:03.697976 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:03.697947 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 14:31:03.915826 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:03.915784 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4kkr2" event={"ID":"c22eb984-70ae-410e-ad51-48a3a55ce8f5","Type":"ContainerStarted","Data":"22df2ca7b5ff351506064fb22999badf4e597a132d339a418b7e24a8a67678ef"} Jul 15 14:31:03.917710 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:03.917678 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" event={"ID":"35a5e520-4d79-4b8a-9954-5ab6f67d5412","Type":"ContainerStarted","Data":"ad02a440d9f68d7f534561a359a5648127a3df29e62a2ed5540504f19845f0be"} Jul 15 14:31:03.920675 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:03.920650 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" event={"ID":"29cee31f-448b-4475-ac84-e7778c196610","Type":"ContainerStarted","Data":"04189ac447089938ca5df20e0c1ad4b453a862dd846f4627b67dde6c798dfeb5"} Jul 15 14:31:04.193358 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:04.193277 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wjj78" Jul 15 14:31:04.193900 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:04.193880 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wjj78" Jul 15 14:31:04.218328 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:04.218278 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4kkr2" podStartSLOduration=5.702607895 podStartE2EDuration="24.218261495s" totalImagesPullingTime="18.5156536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:03.931417211 +0000 UTC m=+23.804351770" watchObservedRunningTime="2026-07-15 14:31:04.218261495 +0000 UTC m=+24.091196063" Jul 15 14:31:04.570770 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:04.570646 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T14:31:03.697969781Z","UUID":"98f4051e-1b6d-4371-971f-d32eb99dcb12","Handler":null,"Name":"","Endpoint":""} Jul 15 14:31:04.572575 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:04.572554 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 14:31:04.572705 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:04.572598 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 14:31:04.674239 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:04.674209 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:31:04.674404 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:04.674333 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddnm2" podUID="f1057e5f-10da-45d8-914f-2fec1ee7419b" Jul 15 14:31:04.923334 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:04.923305 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wjj78" Jul 15 14:31:04.923881 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:04.923607 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wjj78" Jul 15 14:31:05.670857 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:05.670822 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:31:05.671051 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:05.670823 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:31:05.671051 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:05.670952 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sn4mn" podUID="081c09ac-5d7f-457e-b63a-354d4d4c793f" Jul 15 14:31:05.671051 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:05.671032 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jv5jr" podUID="5231db67-ee3e-41f3-9cc4-8819edeedb57" Jul 15 14:31:05.927767 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:05.927471 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" event={"ID":"35a5e520-4d79-4b8a-9954-5ab6f67d5412","Type":"ContainerStarted","Data":"6f878e11af79bcbb536a3ec8ae800f3668839b8b4cf8c50bf834b0f5397c1c2c"} Jul 15 14:31:05.931177 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:05.931129 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" event={"ID":"29cee31f-448b-4475-ac84-e7778c196610","Type":"ContainerStarted","Data":"8621d653a3e82bc8d73c6344b08e8e2789eb7aa3faa5dd8868ddf9ec2eb26025"} Jul 15 14:31:05.949575 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:05.949530 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tvjsg" podStartSLOduration=4.744115703 podStartE2EDuration="25.949517185s" totalImagesPullingTime="21.205401482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:05.948125859 +0000 UTC m=+25.821060419" watchObservedRunningTime="2026-07-15 14:31:05.949517185 +0000 UTC m=+25.822451771" Jul 15 14:31:06.674320 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:06.674291 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:31:06.674476 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:06.674399 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddnm2" podUID="f1057e5f-10da-45d8-914f-2fec1ee7419b" Jul 15 14:31:07.671339 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:07.671257 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:31:07.671339 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:07.671277 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:31:07.672209 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:07.671367 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sn4mn" podUID="081c09ac-5d7f-457e-b63a-354d4d4c793f" Jul 15 14:31:07.672209 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:07.671499 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jv5jr" podUID="5231db67-ee3e-41f3-9cc4-8819edeedb57" Jul 15 14:31:07.938979 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:07.938884 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" event={"ID":"29cee31f-448b-4475-ac84-e7778c196610","Type":"ContainerStarted","Data":"adbefafbd2fbcbda3ed8e175db018b3781d577c4b36bb94ab2aef0ad105f6eba"} Jul 15 14:31:07.939421 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:07.939385 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:31:07.939545 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:07.939462 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:31:07.956358 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:07.956327 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:31:07.956487 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:07.956438 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:31:07.993032 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:07.992986 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" podStartSLOduration=9.38709858 podStartE2EDuration="27.992971353s" totalImagesPullingTime="18.605872773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:07.992717499 +0000 UTC m=+27.865652058" watchObservedRunningTime="2026-07-15 14:31:07.992971353 +0000 UTC m=+27.865905913" Jul 15 14:31:08.671784 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:08.671479 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:31:08.672241 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:08.671857 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddnm2" podUID="f1057e5f-10da-45d8-914f-2fec1ee7419b" Jul 15 14:31:08.940497 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:08.940429 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 15 14:31:09.671201 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:09.671171 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:31:09.671373 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:09.671287 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sn4mn" podUID="081c09ac-5d7f-457e-b63a-354d4d4c793f" Jul 15 14:31:09.671373 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:09.671336 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:31:09.671489 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:09.671463 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jv5jr" podUID="5231db67-ee3e-41f3-9cc4-8819edeedb57" Jul 15 14:31:09.673245 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:09.673220 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:31:09.722033 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:09.721997 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ddnm2"] Jul 15 14:31:09.722186 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:09.722130 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:31:09.722248 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:09.722226 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddnm2" podUID="f1057e5f-10da-45d8-914f-2fec1ee7419b" Jul 15 14:31:09.725266 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:09.725238 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jv5jr"] Jul 15 14:31:09.725966 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:09.725941 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sn4mn"] Jul 15 14:31:09.942852 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:09.942769 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:31:09.942852 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:09.942769 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:31:09.943019 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:09.942908 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sn4mn" podUID="081c09ac-5d7f-457e-b63a-354d4d4c793f" Jul 15 14:31:09.943019 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:09.942965 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jv5jr" podUID="5231db67-ee3e-41f3-9cc4-8819edeedb57" Jul 15 14:31:11.670869 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:11.670836 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:31:11.670869 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:11.670864 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:31:11.671335 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:11.670837 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:31:11.671335 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:11.670983 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sn4mn" podUID="081c09ac-5d7f-457e-b63a-354d4d4c793f" Jul 15 14:31:11.671335 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:11.671036 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddnm2" podUID="f1057e5f-10da-45d8-914f-2fec1ee7419b" Jul 15 14:31:11.671335 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:11.671128 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jv5jr" podUID="5231db67-ee3e-41f3-9cc4-8819edeedb57" Jul 15 14:31:11.948909 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:11.948871 2565 generic.go:356] "Generic (PLEG): container finished" podID="95033e7d-b1fc-4636-8587-0303f98e3ded" containerID="394c45c6002a5cee153558351ee598eecb47e0c7d939b66b5afe5422371de07f" exitCode=0 Jul 15 14:31:11.949050 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:11.948938 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4w7p" event={"ID":"95033e7d-b1fc-4636-8587-0303f98e3ded","Type":"ContainerDied","Data":"394c45c6002a5cee153558351ee598eecb47e0c7d939b66b5afe5422371de07f"} Jul 15 14:31:12.953486 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:12.953285 2565 generic.go:356] "Generic (PLEG): container finished" podID="95033e7d-b1fc-4636-8587-0303f98e3ded" containerID="bee41d83a28a0d6b51319ea8b2d70e902cc502dc22de71df6f4da19b4a852cf7" exitCode=0 Jul 15 14:31:12.953486 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:12.953356 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4w7p" event={"ID":"95033e7d-b1fc-4636-8587-0303f98e3ded","Type":"ContainerDied","Data":"bee41d83a28a0d6b51319ea8b2d70e902cc502dc22de71df6f4da19b4a852cf7"} Jul 15 14:31:13.671602 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:13.671567 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:31:13.671803 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:13.671567 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:31:13.671803 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:13.671669 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddnm2" podUID="f1057e5f-10da-45d8-914f-2fec1ee7419b" Jul 15 14:31:13.671803 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:13.671777 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sn4mn" podUID="081c09ac-5d7f-457e-b63a-354d4d4c793f" Jul 15 14:31:13.671803 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:13.671567 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:31:13.671988 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:13.671889 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jv5jr" podUID="5231db67-ee3e-41f3-9cc4-8819edeedb57" Jul 15 14:31:13.958150 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:13.958120 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4w7p" event={"ID":"95033e7d-b1fc-4636-8587-0303f98e3ded","Type":"ContainerStarted","Data":"a796f37b8ffc2401574897854910c5c60e5c0e29f9ba961618ee5dbbf935a3a9"} Jul 15 14:31:14.281076 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:14.280973 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs\") pod \"network-metrics-daemon-sn4mn\" (UID: \"081c09ac-5d7f-457e-b63a-354d4d4c793f\") " pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:31:14.281230 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:14.281082 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret\") pod \"global-pull-secret-syncer-ddnm2\" (UID: \"f1057e5f-10da-45d8-914f-2fec1ee7419b\") " pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:31:14.281230 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:14.281129 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 14:31:14.281230 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:14.281161 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 14:31:14.281230 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:14.281202 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs podName:081c09ac-5d7f-457e-b63a-354d4d4c793f nodeName:}" failed. No retries permitted until 2026-07-15 14:31:46.281182961 +0000 UTC m=+66.154117512 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs") pod "network-metrics-daemon-sn4mn" (UID: "081c09ac-5d7f-457e-b63a-354d4d4c793f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 14:31:14.281230 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:14.281217 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret podName:f1057e5f-10da-45d8-914f-2fec1ee7419b nodeName:}" failed. No retries permitted until 2026-07-15 14:31:46.281210353 +0000 UTC m=+66.154144894 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret") pod "global-pull-secret-syncer-ddnm2" (UID: "f1057e5f-10da-45d8-914f-2fec1ee7419b") : object "kube-system"/"original-pull-secret" not registered Jul 15 14:31:14.481959 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:14.481919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fld5c\" (UniqueName: \"kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c\") pod \"network-check-target-jv5jr\" (UID: \"5231db67-ee3e-41f3-9cc4-8819edeedb57\") " pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:31:14.482206 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:14.482086 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 14:31:14.482206 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:14.482106 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 14:31:14.482206 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:14.482116 2565 projected.go:196] Error preparing data for projected volume kube-api-access-fld5c for pod openshift-network-diagnostics/network-check-target-jv5jr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 14:31:14.482206 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:14.482165 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c podName:5231db67-ee3e-41f3-9cc4-8819edeedb57 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:46.482151521 +0000 UTC m=+66.355086060 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fld5c" (UniqueName: "kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c") pod "network-check-target-jv5jr" (UID: "5231db67-ee3e-41f3-9cc4-8819edeedb57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 14:31:14.962676 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:14.962639 2565 generic.go:356] "Generic (PLEG): container finished" podID="95033e7d-b1fc-4636-8587-0303f98e3ded" containerID="a796f37b8ffc2401574897854910c5c60e5c0e29f9ba961618ee5dbbf935a3a9" exitCode=0 Jul 15 14:31:14.963136 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:14.962682 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4w7p" event={"ID":"95033e7d-b1fc-4636-8587-0303f98e3ded","Type":"ContainerDied","Data":"a796f37b8ffc2401574897854910c5c60e5c0e29f9ba961618ee5dbbf935a3a9"} Jul 15 14:31:15.671010 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:15.670969 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:31:15.671200 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:15.670969 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:31:15.671200 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:15.671105 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ddnm2" podUID="f1057e5f-10da-45d8-914f-2fec1ee7419b" Jul 15 14:31:15.671325 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:15.671202 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jv5jr" podUID="5231db67-ee3e-41f3-9cc4-8819edeedb57" Jul 15 14:31:15.671325 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:15.670969 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:31:15.671426 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:15.671335 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sn4mn" podUID="081c09ac-5d7f-457e-b63a-354d4d4c793f" Jul 15 14:31:15.943497 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:15.943409 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeReady" Jul 15 14:31:15.943660 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:15.943553 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 14:31:15.995190 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:15.995159 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wdhdj"] Jul 15 14:31:16.019978 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.019945 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qd5nk"] Jul 15 14:31:16.020155 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.020073 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:16.023941 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.023911 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 14:31:16.024295 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.024273 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 14:31:16.024439 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.024273 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ns9wp\"" Jul 15 14:31:16.036020 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.035997 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wdhdj"] Jul 15 14:31:16.036143 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.036036 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qd5nk"] Jul 15 14:31:16.036143 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.036102 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qd5nk" Jul 15 14:31:16.038971 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.038955 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 14:31:16.039346 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.039326 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 14:31:16.039431 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.039354 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z26g2\"" Jul 15 14:31:16.039584 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.039569 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 14:31:16.195553 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.195476 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5acfc7c-04db-4f37-9c8e-9476855d4508-config-volume\") pod \"dns-default-wdhdj\" (UID: \"e5acfc7c-04db-4f37-9c8e-9476855d4508\") " pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:16.195553 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.195509 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls\") pod \"dns-default-wdhdj\" (UID: \"e5acfc7c-04db-4f37-9c8e-9476855d4508\") " pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:16.195553 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.195528 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtcbq\" (UniqueName: \"kubernetes.io/projected/70955b42-9a85-4954-8234-3b3e1ed5192e-kube-api-access-qtcbq\") pod \"ingress-canary-qd5nk\" (UID: \"70955b42-9a85-4954-8234-3b3e1ed5192e\") " pod="openshift-ingress-canary/ingress-canary-qd5nk" Jul 15 14:31:16.195850 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.195665 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70955b42-9a85-4954-8234-3b3e1ed5192e-cert\") pod \"ingress-canary-qd5nk\" (UID: \"70955b42-9a85-4954-8234-3b3e1ed5192e\") " pod="openshift-ingress-canary/ingress-canary-qd5nk" Jul 15 14:31:16.195850 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.195719 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5acfc7c-04db-4f37-9c8e-9476855d4508-tmp-dir\") pod \"dns-default-wdhdj\" (UID: \"e5acfc7c-04db-4f37-9c8e-9476855d4508\") " pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:16.195850 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.195749 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbxpn\" (UniqueName: \"kubernetes.io/projected/e5acfc7c-04db-4f37-9c8e-9476855d4508-kube-api-access-kbxpn\") pod \"dns-default-wdhdj\" (UID: \"e5acfc7c-04db-4f37-9c8e-9476855d4508\") " pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:16.296859 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.296797 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5acfc7c-04db-4f37-9c8e-9476855d4508-tmp-dir\") pod \"dns-default-wdhdj\" (UID: \"e5acfc7c-04db-4f37-9c8e-9476855d4508\") " pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:16.297026 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.296863 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbxpn\" (UniqueName: \"kubernetes.io/projected/e5acfc7c-04db-4f37-9c8e-9476855d4508-kube-api-access-kbxpn\") pod \"dns-default-wdhdj\" (UID: \"e5acfc7c-04db-4f37-9c8e-9476855d4508\") " pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:16.297026 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.296922 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5acfc7c-04db-4f37-9c8e-9476855d4508-config-volume\") pod \"dns-default-wdhdj\" (UID: \"e5acfc7c-04db-4f37-9c8e-9476855d4508\") " pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:16.297026 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.296946 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls\") pod \"dns-default-wdhdj\" (UID: \"e5acfc7c-04db-4f37-9c8e-9476855d4508\") " pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:16.297026 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.296973 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtcbq\" (UniqueName: \"kubernetes.io/projected/70955b42-9a85-4954-8234-3b3e1ed5192e-kube-api-access-qtcbq\") pod \"ingress-canary-qd5nk\" (UID: \"70955b42-9a85-4954-8234-3b3e1ed5192e\") " pod="openshift-ingress-canary/ingress-canary-qd5nk" Jul 15 14:31:16.297026 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.297015 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70955b42-9a85-4954-8234-3b3e1ed5192e-cert\") pod \"ingress-canary-qd5nk\" (UID: \"70955b42-9a85-4954-8234-3b3e1ed5192e\") " pod="openshift-ingress-canary/ingress-canary-qd5nk" Jul 15 14:31:16.297262 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.297168 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5acfc7c-04db-4f37-9c8e-9476855d4508-tmp-dir\") pod \"dns-default-wdhdj\" (UID: \"e5acfc7c-04db-4f37-9c8e-9476855d4508\") " pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:16.297262 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:16.297176 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 14:31:16.297262 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:16.297256 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls podName:e5acfc7c-04db-4f37-9c8e-9476855d4508 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:16.797234037 +0000 UTC m=+36.670168590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls") pod "dns-default-wdhdj" (UID: "e5acfc7c-04db-4f37-9c8e-9476855d4508") : secret "dns-default-metrics-tls" not found Jul 15 14:31:16.297520 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.297500 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5acfc7c-04db-4f37-9c8e-9476855d4508-config-volume\") pod \"dns-default-wdhdj\" (UID: \"e5acfc7c-04db-4f37-9c8e-9476855d4508\") " pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:16.301730 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.301704 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70955b42-9a85-4954-8234-3b3e1ed5192e-cert\") pod \"ingress-canary-qd5nk\" (UID: \"70955b42-9a85-4954-8234-3b3e1ed5192e\") " pod="openshift-ingress-canary/ingress-canary-qd5nk" Jul 15 14:31:16.310035 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.310012 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbxpn\" (UniqueName: \"kubernetes.io/projected/e5acfc7c-04db-4f37-9c8e-9476855d4508-kube-api-access-kbxpn\") pod \"dns-default-wdhdj\" (UID: \"e5acfc7c-04db-4f37-9c8e-9476855d4508\") " pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:16.310146 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.310090 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtcbq\" (UniqueName: \"kubernetes.io/projected/70955b42-9a85-4954-8234-3b3e1ed5192e-kube-api-access-qtcbq\") pod \"ingress-canary-qd5nk\" (UID: \"70955b42-9a85-4954-8234-3b3e1ed5192e\") " pod="openshift-ingress-canary/ingress-canary-qd5nk" Jul 15 14:31:16.346036 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.346001 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qd5nk" Jul 15 14:31:16.559598 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.559564 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qd5nk"] Jul 15 14:31:16.563740 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:31:16.563713 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70955b42_9a85_4954_8234_3b3e1ed5192e.slice/crio-728b359702aae37d3eba053f65451485b740e3681a23cadc512be4b9e9b10430 WatchSource:0}: Error finding container 728b359702aae37d3eba053f65451485b740e3681a23cadc512be4b9e9b10430: Status 404 returned error can't find the container with id 728b359702aae37d3eba053f65451485b740e3681a23cadc512be4b9e9b10430 Jul 15 14:31:16.802441 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.802141 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls\") pod \"dns-default-wdhdj\" (UID: \"e5acfc7c-04db-4f37-9c8e-9476855d4508\") " pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:16.802441 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:16.802303 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 14:31:16.802643 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:16.802474 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls podName:e5acfc7c-04db-4f37-9c8e-9476855d4508 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:17.802456332 +0000 UTC m=+37.675390870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls") pod "dns-default-wdhdj" (UID: "e5acfc7c-04db-4f37-9c8e-9476855d4508") : secret "dns-default-metrics-tls" not found Jul 15 14:31:16.985659 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:16.985623 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qd5nk" event={"ID":"70955b42-9a85-4954-8234-3b3e1ed5192e","Type":"ContainerStarted","Data":"728b359702aae37d3eba053f65451485b740e3681a23cadc512be4b9e9b10430"} Jul 15 14:31:17.670687 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:17.670618 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:31:17.670687 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:17.670662 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:31:17.670687 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:17.670662 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:31:17.674183 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:17.674161 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 14:31:17.675344 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:17.675285 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 14:31:17.675344 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:17.675296 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cj2n5\"" Jul 15 14:31:17.675344 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:17.675329 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 14:31:17.675572 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:17.675290 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 14:31:17.675572 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:17.675509 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cqtkh\"" Jul 15 14:31:17.810073 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:17.810019 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls\") pod \"dns-default-wdhdj\" (UID: \"e5acfc7c-04db-4f37-9c8e-9476855d4508\") " pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:17.810257 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:17.810145 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 14:31:17.810257 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:17.810223 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls podName:e5acfc7c-04db-4f37-9c8e-9476855d4508 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:19.810202749 +0000 UTC m=+39.683137339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls") pod "dns-default-wdhdj" (UID: "e5acfc7c-04db-4f37-9c8e-9476855d4508") : secret "dns-default-metrics-tls" not found Jul 15 14:31:19.821947 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:19.821906 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls\") pod \"dns-default-wdhdj\" (UID: \"e5acfc7c-04db-4f37-9c8e-9476855d4508\") " pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:19.822378 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:19.822040 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 14:31:19.822378 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:19.822110 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls podName:e5acfc7c-04db-4f37-9c8e-9476855d4508 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:23.822091212 +0000 UTC m=+43.695025772 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls") pod "dns-default-wdhdj" (UID: "e5acfc7c-04db-4f37-9c8e-9476855d4508") : secret "dns-default-metrics-tls" not found Jul 15 14:31:20.997681 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:20.997640 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qd5nk" event={"ID":"70955b42-9a85-4954-8234-3b3e1ed5192e","Type":"ContainerStarted","Data":"da57f90aae7958cd31734ad13b3e5b8a9a07d8d437458e36b9174de83dd69251"} Jul 15 14:31:21.000293 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:21.000270 2565 generic.go:356] "Generic (PLEG): container finished" podID="95033e7d-b1fc-4636-8587-0303f98e3ded" containerID="ee4dac1922efed0fd2da7bdf8fabaff81e68765edadbac2037875ffb4e186c85" exitCode=0 Jul 15 14:31:21.000422 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:21.000310 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4w7p" event={"ID":"95033e7d-b1fc-4636-8587-0303f98e3ded","Type":"ContainerDied","Data":"ee4dac1922efed0fd2da7bdf8fabaff81e68765edadbac2037875ffb4e186c85"} Jul 15 14:31:21.020355 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:21.020312 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qd5nk" podStartSLOduration=2.218227541 podStartE2EDuration="6.020299107s" totalImagesPullingTime="3.802071566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:21.019505325 +0000 UTC m=+40.892439886" watchObservedRunningTime="2026-07-15 14:31:21.020299107 +0000 UTC m=+40.893233678" Jul 15 14:31:22.005308 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:22.005272 2565 generic.go:356] "Generic (PLEG): container finished" podID="95033e7d-b1fc-4636-8587-0303f98e3ded" containerID="f4a78bdc20aad83b1d8dfbde2a71987d47b7bb4a0580618c23db7b3e6fbc0740" exitCode=0 Jul 15 14:31:22.005745 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:22.005313 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4w7p" event={"ID":"95033e7d-b1fc-4636-8587-0303f98e3ded","Type":"ContainerDied","Data":"f4a78bdc20aad83b1d8dfbde2a71987d47b7bb4a0580618c23db7b3e6fbc0740"} Jul 15 14:31:23.010932 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:23.010901 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4w7p" event={"ID":"95033e7d-b1fc-4636-8587-0303f98e3ded","Type":"ContainerStarted","Data":"d48cd0b8c64b90ab722b3e6729531ee6f34c9db8b5367fb0cfda9e5bc7eca616"} Jul 15 14:31:23.041417 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:23.041368 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l4w7p" podStartSLOduration=8.573323134 podStartE2EDuration="43.041351241s" totalImagesPullingTime="34.468028107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:23.038876022 +0000 UTC m=+42.911810582" watchObservedRunningTime="2026-07-15 14:31:23.041351241 +0000 UTC m=+42.914286016" Jul 15 14:31:23.849273 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:23.849227 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls\") pod \"dns-default-wdhdj\" (UID: \"e5acfc7c-04db-4f37-9c8e-9476855d4508\") " pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:23.849458 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:23.849387 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 14:31:23.849458 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:23.849451 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls podName:e5acfc7c-04db-4f37-9c8e-9476855d4508 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:31.849434298 +0000 UTC m=+51.722368835 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls") pod "dns-default-wdhdj" (UID: "e5acfc7c-04db-4f37-9c8e-9476855d4508") : secret "dns-default-metrics-tls" not found Jul 15 14:31:26.432346 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.432305 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p87cs"] Jul 15 14:31:26.467917 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.467890 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p87cs"] Jul 15 14:31:26.468064 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.467992 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:26.472652 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.472624 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 14:31:26.472818 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.472624 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 14:31:26.473635 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.473615 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 14:31:26.473737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.473634 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 14:31:26.473737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.473634 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qr4w9\"" Jul 15 14:31:26.566576 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.566541 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4afda59e-88f5-4b3a-9f2e-76325ee1d636-crio-socket\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:26.566576 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.566579 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4afda59e-88f5-4b3a-9f2e-76325ee1d636-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:26.566790 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.566608 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjfbm\" (UniqueName: \"kubernetes.io/projected/4afda59e-88f5-4b3a-9f2e-76325ee1d636-kube-api-access-wjfbm\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:26.566790 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.566628 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4afda59e-88f5-4b3a-9f2e-76325ee1d636-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:26.566790 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.566685 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4afda59e-88f5-4b3a-9f2e-76325ee1d636-data-volume\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:26.611279 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.611249 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sjhh8"] Jul 15 14:31:26.633602 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.633575 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sjhh8"] Jul 15 14:31:26.633747 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.633673 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sjhh8" Jul 15 14:31:26.636566 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.636544 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 15 14:31:26.636692 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.636566 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 15 14:31:26.636692 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.636618 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-krvhv\"" Jul 15 14:31:26.667451 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.667419 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjfbm\" (UniqueName: \"kubernetes.io/projected/4afda59e-88f5-4b3a-9f2e-76325ee1d636-kube-api-access-wjfbm\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:26.667611 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.667455 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8w2j\" (UniqueName: \"kubernetes.io/projected/0ac005bc-71bf-4ee6-b835-e26e4923ab4d-kube-api-access-l8w2j\") pod \"migrator-7f59b54f6c-sjhh8\" (UID: \"0ac005bc-71bf-4ee6-b835-e26e4923ab4d\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sjhh8" Jul 15 14:31:26.667611 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.667484 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4afda59e-88f5-4b3a-9f2e-76325ee1d636-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:26.667611 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.667520 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4afda59e-88f5-4b3a-9f2e-76325ee1d636-data-volume\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:26.667611 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:26.667584 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 14:31:26.667611 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.667599 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4afda59e-88f5-4b3a-9f2e-76325ee1d636-crio-socket\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:26.667847 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:26.667633 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4afda59e-88f5-4b3a-9f2e-76325ee1d636-insights-runtime-extractor-tls podName:4afda59e-88f5-4b3a-9f2e-76325ee1d636 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:27.167616932 +0000 UTC m=+47.040551470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4afda59e-88f5-4b3a-9f2e-76325ee1d636-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p87cs" (UID: "4afda59e-88f5-4b3a-9f2e-76325ee1d636") : secret "insights-runtime-extractor-tls" not found Jul 15 14:31:26.667847 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.667657 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4afda59e-88f5-4b3a-9f2e-76325ee1d636-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:26.667847 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:26.667714 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 14:31:26.667847 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:26.667749 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4afda59e-88f5-4b3a-9f2e-76325ee1d636-kube-rbac-proxy-cm podName:4afda59e-88f5-4b3a-9f2e-76325ee1d636 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:27.167742088 +0000 UTC m=+47.040676626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4afda59e-88f5-4b3a-9f2e-76325ee1d636-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p87cs" (UID: "4afda59e-88f5-4b3a-9f2e-76325ee1d636") : configmap "kube-rbac-proxy" not found Jul 15 14:31:26.667847 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.667796 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4afda59e-88f5-4b3a-9f2e-76325ee1d636-crio-socket\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:26.668032 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.667913 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4afda59e-88f5-4b3a-9f2e-76325ee1d636-data-volume\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:26.679325 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.679304 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjfbm\" (UniqueName: \"kubernetes.io/projected/4afda59e-88f5-4b3a-9f2e-76325ee1d636-kube-api-access-wjfbm\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:26.768934 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.768845 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8w2j\" (UniqueName: \"kubernetes.io/projected/0ac005bc-71bf-4ee6-b835-e26e4923ab4d-kube-api-access-l8w2j\") pod \"migrator-7f59b54f6c-sjhh8\" (UID: \"0ac005bc-71bf-4ee6-b835-e26e4923ab4d\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sjhh8" Jul 15 14:31:26.777275 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.777249 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8w2j\" (UniqueName: \"kubernetes.io/projected/0ac005bc-71bf-4ee6-b835-e26e4923ab4d-kube-api-access-l8w2j\") pod \"migrator-7f59b54f6c-sjhh8\" (UID: \"0ac005bc-71bf-4ee6-b835-e26e4923ab4d\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sjhh8" Jul 15 14:31:26.942227 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:26.942186 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sjhh8" Jul 15 14:31:27.080720 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:27.080691 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sjhh8"] Jul 15 14:31:27.083844 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:31:27.083792 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac005bc_71bf_4ee6_b835_e26e4923ab4d.slice/crio-d43317989b8b7c70dce5817d096a61d6bf23cb03acc8be10e91a270ad30f9e8f WatchSource:0}: Error finding container d43317989b8b7c70dce5817d096a61d6bf23cb03acc8be10e91a270ad30f9e8f: Status 404 returned error can't find the container with id d43317989b8b7c70dce5817d096a61d6bf23cb03acc8be10e91a270ad30f9e8f Jul 15 14:31:27.172106 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:27.172052 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4afda59e-88f5-4b3a-9f2e-76325ee1d636-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:27.172259 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:27.172125 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4afda59e-88f5-4b3a-9f2e-76325ee1d636-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:27.172259 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:27.172172 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 14:31:27.172259 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:27.172216 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 14:31:27.172259 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:27.172239 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4afda59e-88f5-4b3a-9f2e-76325ee1d636-kube-rbac-proxy-cm podName:4afda59e-88f5-4b3a-9f2e-76325ee1d636 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:28.172224089 +0000 UTC m=+48.045158627 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4afda59e-88f5-4b3a-9f2e-76325ee1d636-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p87cs" (UID: "4afda59e-88f5-4b3a-9f2e-76325ee1d636") : configmap "kube-rbac-proxy" not found Jul 15 14:31:27.172259 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:27.172259 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4afda59e-88f5-4b3a-9f2e-76325ee1d636-insights-runtime-extractor-tls podName:4afda59e-88f5-4b3a-9f2e-76325ee1d636 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:28.172247546 +0000 UTC m=+48.045182084 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4afda59e-88f5-4b3a-9f2e-76325ee1d636-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p87cs" (UID: "4afda59e-88f5-4b3a-9f2e-76325ee1d636") : secret "insights-runtime-extractor-tls" not found Jul 15 14:31:28.023257 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:28.023222 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sjhh8" event={"ID":"0ac005bc-71bf-4ee6-b835-e26e4923ab4d","Type":"ContainerStarted","Data":"d43317989b8b7c70dce5817d096a61d6bf23cb03acc8be10e91a270ad30f9e8f"} Jul 15 14:31:28.179647 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:28.179608 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4afda59e-88f5-4b3a-9f2e-76325ee1d636-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:28.179798 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:28.179666 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4afda59e-88f5-4b3a-9f2e-76325ee1d636-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:28.179798 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:28.179732 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 14:31:28.179958 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:28.179828 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 14:31:28.179958 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:28.179832 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4afda59e-88f5-4b3a-9f2e-76325ee1d636-kube-rbac-proxy-cm podName:4afda59e-88f5-4b3a-9f2e-76325ee1d636 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:30.179800031 +0000 UTC m=+50.052734569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4afda59e-88f5-4b3a-9f2e-76325ee1d636-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p87cs" (UID: "4afda59e-88f5-4b3a-9f2e-76325ee1d636") : configmap "kube-rbac-proxy" not found Jul 15 14:31:28.179958 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:28.179890 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4afda59e-88f5-4b3a-9f2e-76325ee1d636-insights-runtime-extractor-tls podName:4afda59e-88f5-4b3a-9f2e-76325ee1d636 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:30.179875649 +0000 UTC m=+50.052810189 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4afda59e-88f5-4b3a-9f2e-76325ee1d636-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p87cs" (UID: "4afda59e-88f5-4b3a-9f2e-76325ee1d636") : secret "insights-runtime-extractor-tls" not found Jul 15 14:31:28.322757 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:28.322679 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-w2bd7"] Jul 15 14:31:28.341931 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:28.341893 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-w2bd7"] Jul 15 14:31:28.342076 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:28.341983 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-w2bd7" Jul 15 14:31:28.344438 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:28.344413 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 15 14:31:28.344438 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:28.344442 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pqgqm\"" Jul 15 14:31:28.344643 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:28.344413 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 15 14:31:28.381590 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:28.381556 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a71156f-e1ae-440d-9a01-a22d53d505a0-nginx-conf\") pod \"networking-console-plugin-6cf856758c-w2bd7\" (UID: \"6a71156f-e1ae-440d-9a01-a22d53d505a0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w2bd7" Jul 15 14:31:28.381749 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:28.381705 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a71156f-e1ae-440d-9a01-a22d53d505a0-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-w2bd7\" (UID: \"6a71156f-e1ae-440d-9a01-a22d53d505a0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w2bd7" Jul 15 14:31:28.426255 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:28.426228 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7gpxl_79dd4fed-463d-4100-8267-e2165857f17d/dns-node-resolver/0.log" Jul 15 14:31:28.483202 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:28.483151 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a71156f-e1ae-440d-9a01-a22d53d505a0-nginx-conf\") pod \"networking-console-plugin-6cf856758c-w2bd7\" (UID: \"6a71156f-e1ae-440d-9a01-a22d53d505a0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w2bd7" Jul 15 14:31:28.483424 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:28.483401 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a71156f-e1ae-440d-9a01-a22d53d505a0-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-w2bd7\" (UID: \"6a71156f-e1ae-440d-9a01-a22d53d505a0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w2bd7" Jul 15 14:31:28.483531 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:28.483518 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 14:31:28.483590 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:28.483582 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a71156f-e1ae-440d-9a01-a22d53d505a0-networking-console-plugin-cert podName:6a71156f-e1ae-440d-9a01-a22d53d505a0 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:28.983567694 +0000 UTC m=+48.856502232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a71156f-e1ae-440d-9a01-a22d53d505a0-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-w2bd7" (UID: "6a71156f-e1ae-440d-9a01-a22d53d505a0") : secret "networking-console-plugin-cert" not found Jul 15 14:31:28.483907 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:28.483884 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a71156f-e1ae-440d-9a01-a22d53d505a0-nginx-conf\") pod \"networking-console-plugin-6cf856758c-w2bd7\" (UID: \"6a71156f-e1ae-440d-9a01-a22d53d505a0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w2bd7" Jul 15 14:31:28.987148 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:28.987118 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a71156f-e1ae-440d-9a01-a22d53d505a0-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-w2bd7\" (UID: \"6a71156f-e1ae-440d-9a01-a22d53d505a0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w2bd7" Jul 15 14:31:28.987260 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:28.987232 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 14:31:28.987299 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:28.987295 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a71156f-e1ae-440d-9a01-a22d53d505a0-networking-console-plugin-cert podName:6a71156f-e1ae-440d-9a01-a22d53d505a0 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:29.987281558 +0000 UTC m=+49.860216095 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a71156f-e1ae-440d-9a01-a22d53d505a0-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-w2bd7" (UID: "6a71156f-e1ae-440d-9a01-a22d53d505a0") : secret "networking-console-plugin-cert" not found Jul 15 14:31:29.026876 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:29.026850 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sjhh8" event={"ID":"0ac005bc-71bf-4ee6-b835-e26e4923ab4d","Type":"ContainerStarted","Data":"1a8c84b8172161a18625f0be55afd06f93a23a94026e7062af8cec25f1501f68"} Jul 15 14:31:29.625314 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:29.625286 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f5t4p_5f454a34-849a-4a48-bd4f-845c5bf5c3c8/node-ca/0.log" Jul 15 14:31:29.994291 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:29.994254 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a71156f-e1ae-440d-9a01-a22d53d505a0-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-w2bd7\" (UID: \"6a71156f-e1ae-440d-9a01-a22d53d505a0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w2bd7" Jul 15 14:31:29.994490 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:29.994433 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 14:31:29.994557 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:29.994513 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a71156f-e1ae-440d-9a01-a22d53d505a0-networking-console-plugin-cert podName:6a71156f-e1ae-440d-9a01-a22d53d505a0 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:31.994494242 +0000 UTC m=+51.867428780 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a71156f-e1ae-440d-9a01-a22d53d505a0-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-w2bd7" (UID: "6a71156f-e1ae-440d-9a01-a22d53d505a0") : secret "networking-console-plugin-cert" not found Jul 15 14:31:30.030662 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:30.030626 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sjhh8" event={"ID":"0ac005bc-71bf-4ee6-b835-e26e4923ab4d","Type":"ContainerStarted","Data":"7073b01e3684b78d6e20b8067881f53d10acc383968bb68c75502dd710b830f7"} Jul 15 14:31:30.050420 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:30.050366 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sjhh8" podStartSLOduration=2.285580955 podStartE2EDuration="4.050350007s" totalImagesPullingTime="1.764769052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:31:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:30.050083607 +0000 UTC m=+49.923018167" watchObservedRunningTime="2026-07-15 14:31:30.050350007 +0000 UTC m=+49.923284567" Jul 15 14:31:30.196368 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:30.196326 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4afda59e-88f5-4b3a-9f2e-76325ee1d636-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:30.196564 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:30.196389 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4afda59e-88f5-4b3a-9f2e-76325ee1d636-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:30.196564 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:30.196456 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 14:31:30.196564 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:30.196515 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 14:31:30.196564 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:30.196525 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4afda59e-88f5-4b3a-9f2e-76325ee1d636-kube-rbac-proxy-cm podName:4afda59e-88f5-4b3a-9f2e-76325ee1d636 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:34.196507677 +0000 UTC m=+54.069442215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4afda59e-88f5-4b3a-9f2e-76325ee1d636-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p87cs" (UID: "4afda59e-88f5-4b3a-9f2e-76325ee1d636") : configmap "kube-rbac-proxy" not found Jul 15 14:31:30.196564 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:30.196554 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4afda59e-88f5-4b3a-9f2e-76325ee1d636-insights-runtime-extractor-tls podName:4afda59e-88f5-4b3a-9f2e-76325ee1d636 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:34.196543499 +0000 UTC m=+54.069478037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4afda59e-88f5-4b3a-9f2e-76325ee1d636-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p87cs" (UID: "4afda59e-88f5-4b3a-9f2e-76325ee1d636") : secret "insights-runtime-extractor-tls" not found Jul 15 14:31:30.225167 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:30.225135 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qd5nk_70955b42-9a85-4954-8234-3b3e1ed5192e/serve-healthcheck-canary/0.log" Jul 15 14:31:31.910707 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:31.910662 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls\") pod \"dns-default-wdhdj\" (UID: \"e5acfc7c-04db-4f37-9c8e-9476855d4508\") " pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:31.911135 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:31.910827 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 14:31:31.911135 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:31.910899 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls podName:e5acfc7c-04db-4f37-9c8e-9476855d4508 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:47.910880064 +0000 UTC m=+67.783814602 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls") pod "dns-default-wdhdj" (UID: "e5acfc7c-04db-4f37-9c8e-9476855d4508") : secret "dns-default-metrics-tls" not found Jul 15 14:31:32.011766 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:32.011725 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a71156f-e1ae-440d-9a01-a22d53d505a0-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-w2bd7\" (UID: \"6a71156f-e1ae-440d-9a01-a22d53d505a0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w2bd7" Jul 15 14:31:32.011940 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:32.011904 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 14:31:32.011978 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:32.011966 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a71156f-e1ae-440d-9a01-a22d53d505a0-networking-console-plugin-cert podName:6a71156f-e1ae-440d-9a01-a22d53d505a0 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:36.011949533 +0000 UTC m=+55.884884085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a71156f-e1ae-440d-9a01-a22d53d505a0-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-w2bd7" (UID: "6a71156f-e1ae-440d-9a01-a22d53d505a0") : secret "networking-console-plugin-cert" not found Jul 15 14:31:34.230236 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:34.230195 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4afda59e-88f5-4b3a-9f2e-76325ee1d636-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:34.230764 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:34.230290 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4afda59e-88f5-4b3a-9f2e-76325ee1d636-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:34.230764 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:34.230346 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 14:31:34.230764 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:34.230414 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4afda59e-88f5-4b3a-9f2e-76325ee1d636-insights-runtime-extractor-tls podName:4afda59e-88f5-4b3a-9f2e-76325ee1d636 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:42.230397978 +0000 UTC m=+62.103332516 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4afda59e-88f5-4b3a-9f2e-76325ee1d636-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p87cs" (UID: "4afda59e-88f5-4b3a-9f2e-76325ee1d636") : secret "insights-runtime-extractor-tls" not found Jul 15 14:31:34.230960 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:34.230795 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4afda59e-88f5-4b3a-9f2e-76325ee1d636-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:36.043265 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:36.043223 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a71156f-e1ae-440d-9a01-a22d53d505a0-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-w2bd7\" (UID: \"6a71156f-e1ae-440d-9a01-a22d53d505a0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w2bd7" Jul 15 14:31:36.043761 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:36.043370 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 14:31:36.043761 ip-10-0-136-155 kubenswrapper[2565]: E0715 14:31:36.043439 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a71156f-e1ae-440d-9a01-a22d53d505a0-networking-console-plugin-cert podName:6a71156f-e1ae-440d-9a01-a22d53d505a0 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:44.043422607 +0000 UTC m=+63.916357145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a71156f-e1ae-440d-9a01-a22d53d505a0-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-w2bd7" (UID: "6a71156f-e1ae-440d-9a01-a22d53d505a0") : secret "networking-console-plugin-cert" not found Jul 15 14:31:40.963250 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:40.963219 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rqjt9" Jul 15 14:31:42.291594 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:42.291559 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4afda59e-88f5-4b3a-9f2e-76325ee1d636-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:42.293767 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:42.293745 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4afda59e-88f5-4b3a-9f2e-76325ee1d636-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p87cs\" (UID: \"4afda59e-88f5-4b3a-9f2e-76325ee1d636\") " pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:42.378753 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:42.378723 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qr4w9\"" Jul 15 14:31:42.387541 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:42.387522 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p87cs" Jul 15 14:31:42.512460 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:42.512425 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p87cs"] Jul 15 14:31:42.516665 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:31:42.516636 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4afda59e_88f5_4b3a_9f2e_76325ee1d636.slice/crio-41122f4b6924f4515a2721d7c3b38e6369b66fd015cfbf3feffb6b3e58aa4405 WatchSource:0}: Error finding container 41122f4b6924f4515a2721d7c3b38e6369b66fd015cfbf3feffb6b3e58aa4405: Status 404 returned error can't find the container with id 41122f4b6924f4515a2721d7c3b38e6369b66fd015cfbf3feffb6b3e58aa4405 Jul 15 14:31:43.064356 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:43.064321 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p87cs" event={"ID":"4afda59e-88f5-4b3a-9f2e-76325ee1d636","Type":"ContainerStarted","Data":"41122f4b6924f4515a2721d7c3b38e6369b66fd015cfbf3feffb6b3e58aa4405"} Jul 15 14:31:44.106125 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:44.105562 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a71156f-e1ae-440d-9a01-a22d53d505a0-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-w2bd7\" (UID: \"6a71156f-e1ae-440d-9a01-a22d53d505a0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w2bd7" Jul 15 14:31:44.109305 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:44.109249 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a71156f-e1ae-440d-9a01-a22d53d505a0-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-w2bd7\" (UID: \"6a71156f-e1ae-440d-9a01-a22d53d505a0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w2bd7" Jul 15 14:31:44.254894 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:44.254860 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pqgqm\"" Jul 15 14:31:44.263149 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:44.263120 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-w2bd7" Jul 15 14:31:44.408970 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:44.408938 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-w2bd7"] Jul 15 14:31:44.412252 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:31:44.412224 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a71156f_e1ae_440d_9a01_a22d53d505a0.slice/crio-41272dc1b00955f0102f1fa5e272f1d67f7922502f446f194ad34120155400e2 WatchSource:0}: Error finding container 41272dc1b00955f0102f1fa5e272f1d67f7922502f446f194ad34120155400e2: Status 404 returned error can't find the container with id 41272dc1b00955f0102f1fa5e272f1d67f7922502f446f194ad34120155400e2 Jul 15 14:31:45.072155 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:45.072114 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-w2bd7" event={"ID":"6a71156f-e1ae-440d-9a01-a22d53d505a0","Type":"ContainerStarted","Data":"41272dc1b00955f0102f1fa5e272f1d67f7922502f446f194ad34120155400e2"} Jul 15 14:31:46.077280 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:46.077211 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-w2bd7" event={"ID":"6a71156f-e1ae-440d-9a01-a22d53d505a0","Type":"ContainerStarted","Data":"ebb2329ce9a45f94307aca1bc66e10fdc0788c11ff5137ed5afb243203e74acb"} Jul 15 14:31:46.098909 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:46.098844 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-w2bd7" podStartSLOduration=17.070479479 podStartE2EDuration="18.098823008s" totalImagesPullingTime="1.028343529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:46.097721013 +0000 UTC m=+65.970655573" watchObservedRunningTime="2026-07-15 14:31:46.098823008 +0000 UTC m=+65.971757561" Jul 15 14:31:46.324425 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:46.324387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret\") pod \"global-pull-secret-syncer-ddnm2\" (UID: \"f1057e5f-10da-45d8-914f-2fec1ee7419b\") " pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:31:46.324595 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:46.324461 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs\") pod \"network-metrics-daemon-sn4mn\" (UID: \"081c09ac-5d7f-457e-b63a-354d4d4c793f\") " pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:31:46.327452 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:46.327386 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 14:31:46.327452 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:46.327430 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 14:31:46.337872 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:46.337841 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1057e5f-10da-45d8-914f-2fec1ee7419b-original-pull-secret\") pod \"global-pull-secret-syncer-ddnm2\" (UID: \"f1057e5f-10da-45d8-914f-2fec1ee7419b\") " pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:31:46.338027 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:46.337886 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/081c09ac-5d7f-457e-b63a-354d4d4c793f-metrics-certs\") pod \"network-metrics-daemon-sn4mn\" (UID: \"081c09ac-5d7f-457e-b63a-354d4d4c793f\") " pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:31:46.495540 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:46.495509 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cqtkh\"" Jul 15 14:31:46.499503 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:46.499481 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ddnm2" Jul 15 14:31:46.503604 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:46.503583 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sn4mn" Jul 15 14:31:46.525939 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:46.525908 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fld5c\" (UniqueName: \"kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c\") pod \"network-check-target-jv5jr\" (UID: \"5231db67-ee3e-41f3-9cc4-8819edeedb57\") " pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:31:46.528947 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:46.528927 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 14:31:46.539526 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:46.539509 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 14:31:46.550292 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:46.550265 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fld5c\" (UniqueName: \"kubernetes.io/projected/5231db67-ee3e-41f3-9cc4-8819edeedb57-kube-api-access-fld5c\") pod \"network-check-target-jv5jr\" (UID: \"5231db67-ee3e-41f3-9cc4-8819edeedb57\") " pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:31:46.786921 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:46.786888 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cj2n5\"" Jul 15 14:31:46.794344 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:46.794312 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:31:47.935961 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:47.935926 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls\") pod \"dns-default-wdhdj\" (UID: \"e5acfc7c-04db-4f37-9c8e-9476855d4508\") " pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:47.938062 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:47.938038 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5acfc7c-04db-4f37-9c8e-9476855d4508-metrics-tls\") pod \"dns-default-wdhdj\" (UID: \"e5acfc7c-04db-4f37-9c8e-9476855d4508\") " pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:48.142471 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:48.142435 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ns9wp\"" Jul 15 14:31:48.149639 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:48.149616 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:48.417835 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:48.417768 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jv5jr"] Jul 15 14:31:48.421119 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:31:48.421073 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5231db67_ee3e_41f3_9cc4_8819edeedb57.slice/crio-1d7b1a7fdebf89bbd261e5c1f9f9e84726ec6ddb09c92b73f807b55c11cf3720 WatchSource:0}: Error finding container 1d7b1a7fdebf89bbd261e5c1f9f9e84726ec6ddb09c92b73f807b55c11cf3720: Status 404 returned error can't find the container with id 1d7b1a7fdebf89bbd261e5c1f9f9e84726ec6ddb09c92b73f807b55c11cf3720 Jul 15 14:31:48.432513 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:48.432486 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sn4mn"] Jul 15 14:31:48.435173 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:31:48.435143 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod081c09ac_5d7f_457e_b63a_354d4d4c793f.slice/crio-050272b6b2246ec92e315b958a8e9f9824f867b5dc6118db4f82aa28caf71a10 WatchSource:0}: Error finding container 050272b6b2246ec92e315b958a8e9f9824f867b5dc6118db4f82aa28caf71a10: Status 404 returned error can't find the container with id 050272b6b2246ec92e315b958a8e9f9824f867b5dc6118db4f82aa28caf71a10 Jul 15 14:31:48.444627 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:48.444575 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ddnm2"] Jul 15 14:31:48.447377 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:31:48.447351 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1057e5f_10da_45d8_914f_2fec1ee7419b.slice/crio-0d91c03125eb34d14910968a4efc447f961e7954544031ecc2cb7e8dd3d4c4fe WatchSource:0}: Error finding container 0d91c03125eb34d14910968a4efc447f961e7954544031ecc2cb7e8dd3d4c4fe: Status 404 returned error can't find the container with id 0d91c03125eb34d14910968a4efc447f961e7954544031ecc2cb7e8dd3d4c4fe Jul 15 14:31:48.464907 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:48.464886 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wdhdj"] Jul 15 14:31:48.466955 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:31:48.466935 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5acfc7c_04db_4f37_9c8e_9476855d4508.slice/crio-f595a2f6e5abc5cc1a0a5739c4d9c52df337af5947e1bc76af7a1aaafde46632 WatchSource:0}: Error finding container f595a2f6e5abc5cc1a0a5739c4d9c52df337af5947e1bc76af7a1aaafde46632: Status 404 returned error can't find the container with id f595a2f6e5abc5cc1a0a5739c4d9c52df337af5947e1bc76af7a1aaafde46632 Jul 15 14:31:49.088464 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:49.088376 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wdhdj" event={"ID":"e5acfc7c-04db-4f37-9c8e-9476855d4508","Type":"ContainerStarted","Data":"f595a2f6e5abc5cc1a0a5739c4d9c52df337af5947e1bc76af7a1aaafde46632"} Jul 15 14:31:49.090585 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:49.090512 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jv5jr" event={"ID":"5231db67-ee3e-41f3-9cc4-8819edeedb57","Type":"ContainerStarted","Data":"1d7b1a7fdebf89bbd261e5c1f9f9e84726ec6ddb09c92b73f807b55c11cf3720"} Jul 15 14:31:49.092241 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:49.092216 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ddnm2" event={"ID":"f1057e5f-10da-45d8-914f-2fec1ee7419b","Type":"ContainerStarted","Data":"0d91c03125eb34d14910968a4efc447f961e7954544031ecc2cb7e8dd3d4c4fe"} Jul 15 14:31:49.095662 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:49.095636 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p87cs" event={"ID":"4afda59e-88f5-4b3a-9f2e-76325ee1d636","Type":"ContainerStarted","Data":"92ca02d928d5dd564fa0c3052d640cff8a9f8f34a33965f005e91a18cc7aad42"} Jul 15 14:31:49.098072 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:49.098046 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sn4mn" event={"ID":"081c09ac-5d7f-457e-b63a-354d4d4c793f","Type":"ContainerStarted","Data":"050272b6b2246ec92e315b958a8e9f9824f867b5dc6118db4f82aa28caf71a10"} Jul 15 14:31:49.927768 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:49.926487 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw"] Jul 15 14:31:49.930239 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:49.929166 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:49.933174 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:49.933115 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 15 14:31:49.933174 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:49.933162 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 15 14:31:49.934068 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:49.933958 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 15 14:31:49.935112 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:49.934772 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 15 14:31:49.935337 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:49.935321 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 15 14:31:49.935941 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:49.935737 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 15 14:31:49.936641 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:49.936402 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 15 14:31:49.972342 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:49.972269 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw"] Jul 15 14:31:50.052523 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.052472 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/36ab2e54-2ed4-4a77-b05e-a4de437a0ad8-hub\") pod \"cluster-proxy-proxy-agent-67954d67c4-ltmjw\" (UID: \"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:50.052708 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.052530 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/36ab2e54-2ed4-4a77-b05e-a4de437a0ad8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-67954d67c4-ltmjw\" (UID: \"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:50.052708 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.052560 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/36ab2e54-2ed4-4a77-b05e-a4de437a0ad8-ca\") pod \"cluster-proxy-proxy-agent-67954d67c4-ltmjw\" (UID: \"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:50.052708 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.052598 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36ab2e54-2ed4-4a77-b05e-a4de437a0ad8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67954d67c4-ltmjw\" (UID: \"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:50.052708 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.052622 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/36ab2e54-2ed4-4a77-b05e-a4de437a0ad8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67954d67c4-ltmjw\" (UID: \"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:50.052708 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.052646 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp2rj\" (UniqueName: \"kubernetes.io/projected/36ab2e54-2ed4-4a77-b05e-a4de437a0ad8-kube-api-access-qp2rj\") pod \"cluster-proxy-proxy-agent-67954d67c4-ltmjw\" (UID: \"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:50.153525 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.153486 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/36ab2e54-2ed4-4a77-b05e-a4de437a0ad8-hub\") pod \"cluster-proxy-proxy-agent-67954d67c4-ltmjw\" (UID: \"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:50.154042 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.153552 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/36ab2e54-2ed4-4a77-b05e-a4de437a0ad8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-67954d67c4-ltmjw\" (UID: \"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:50.154042 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.153583 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/36ab2e54-2ed4-4a77-b05e-a4de437a0ad8-ca\") pod \"cluster-proxy-proxy-agent-67954d67c4-ltmjw\" (UID: \"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:50.154042 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.153620 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36ab2e54-2ed4-4a77-b05e-a4de437a0ad8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67954d67c4-ltmjw\" (UID: \"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:50.154042 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.153645 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/36ab2e54-2ed4-4a77-b05e-a4de437a0ad8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67954d67c4-ltmjw\" (UID: \"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:50.154042 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.153670 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp2rj\" (UniqueName: \"kubernetes.io/projected/36ab2e54-2ed4-4a77-b05e-a4de437a0ad8-kube-api-access-qp2rj\") pod \"cluster-proxy-proxy-agent-67954d67c4-ltmjw\" (UID: \"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:50.156038 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.156007 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/36ab2e54-2ed4-4a77-b05e-a4de437a0ad8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-67954d67c4-ltmjw\" (UID: \"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:50.158860 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.158041 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/36ab2e54-2ed4-4a77-b05e-a4de437a0ad8-ca\") pod \"cluster-proxy-proxy-agent-67954d67c4-ltmjw\" (UID: \"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:50.160324 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.160260 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/36ab2e54-2ed4-4a77-b05e-a4de437a0ad8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67954d67c4-ltmjw\" (UID: \"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:50.160994 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.160950 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/36ab2e54-2ed4-4a77-b05e-a4de437a0ad8-hub\") pod \"cluster-proxy-proxy-agent-67954d67c4-ltmjw\" (UID: \"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:50.161090 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.161071 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36ab2e54-2ed4-4a77-b05e-a4de437a0ad8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67954d67c4-ltmjw\" (UID: \"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:50.174503 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.172894 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-666fb5c6c8-9k4pw"] Jul 15 14:31:50.175849 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.175345 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.182683 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.182462 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 14:31:50.184986 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.184186 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 14:31:50.184986 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.184640 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 14:31:50.185557 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.185405 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z6j7k\"" Jul 15 14:31:50.190576 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.190279 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 14:31:50.191142 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.191056 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp2rj\" (UniqueName: \"kubernetes.io/projected/36ab2e54-2ed4-4a77-b05e-a4de437a0ad8-kube-api-access-qp2rj\") pod \"cluster-proxy-proxy-agent-67954d67c4-ltmjw\" (UID: \"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:50.209984 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.209948 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-666fb5c6c8-9k4pw"] Jul 15 14:31:50.253790 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.253759 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" Jul 15 14:31:50.254021 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.253977 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-bound-sa-token\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.254021 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.254018 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-image-registry-private-configuration\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.254209 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.254055 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nghwn\" (UniqueName: \"kubernetes.io/projected/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-kube-api-access-nghwn\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.254209 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.254124 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-registry-tls\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.254209 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.254148 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-installation-pull-secrets\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.254209 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.254180 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-registry-certificates\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.254415 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.254229 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-trusted-ca\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.254415 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.254261 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-ca-trust-extracted\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.356047 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.355272 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nghwn\" (UniqueName: \"kubernetes.io/projected/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-kube-api-access-nghwn\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.356047 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.355346 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-registry-tls\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.356047 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.355373 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-installation-pull-secrets\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.356047 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.355409 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-registry-certificates\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.356047 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.355438 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-trusted-ca\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.356047 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.355468 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-ca-trust-extracted\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.356047 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.355515 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-bound-sa-token\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.356047 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.355540 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-image-registry-private-configuration\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.357873 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.357840 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-trusted-ca\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.358126 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.358105 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-ca-trust-extracted\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.358490 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.358469 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-registry-certificates\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.361246 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.361182 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-image-registry-private-configuration\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.365901 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.365460 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-registry-tls\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.365901 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.365854 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-installation-pull-secrets\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.374111 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.374069 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nghwn\" (UniqueName: \"kubernetes.io/projected/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-kube-api-access-nghwn\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.377845 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.377794 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c6eabc6-a1f2-4540-bc7c-3e78ca48be45-bound-sa-token\") pod \"image-registry-666fb5c6c8-9k4pw\" (UID: \"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45\") " pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:50.490055 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:50.489791 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:56.261573 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:56.261535 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-666fb5c6c8-9k4pw"] Jul 15 14:31:56.267781 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:31:56.267745 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c6eabc6_a1f2_4540_bc7c_3e78ca48be45.slice/crio-6527b99be7970e4d339de18c498d2ce3c88bcfb9e48f5f017dba5a3685ec019e WatchSource:0}: Error finding container 6527b99be7970e4d339de18c498d2ce3c88bcfb9e48f5f017dba5a3685ec019e: Status 404 returned error can't find the container with id 6527b99be7970e4d339de18c498d2ce3c88bcfb9e48f5f017dba5a3685ec019e Jul 15 14:31:56.280855 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:56.278254 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw"] Jul 15 14:31:56.285061 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:31:56.285024 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36ab2e54_2ed4_4a77_b05e_a4de437a0ad8.slice/crio-bbe262da167d37225fdb0ad78fd9faf1f98ebf20a93dfdd00ac9e18e07a00f46 WatchSource:0}: Error finding container bbe262da167d37225fdb0ad78fd9faf1f98ebf20a93dfdd00ac9e18e07a00f46: Status 404 returned error can't find the container with id bbe262da167d37225fdb0ad78fd9faf1f98ebf20a93dfdd00ac9e18e07a00f46 Jul 15 14:31:57.127413 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:57.127359 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ddnm2" event={"ID":"f1057e5f-10da-45d8-914f-2fec1ee7419b","Type":"ContainerStarted","Data":"321cd11ce0750c4f2393a103eafc140eed8c5a5be01add1f4c45a7fd01aee6c9"} Jul 15 14:31:57.130055 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:57.130021 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p87cs" event={"ID":"4afda59e-88f5-4b3a-9f2e-76325ee1d636","Type":"ContainerStarted","Data":"4207492aac56e2a2a6c370570e81c7e2dbb30364fd228646cb950f5989119247"} Jul 15 14:31:57.131390 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:57.131362 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" event={"ID":"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8","Type":"ContainerStarted","Data":"bbe262da167d37225fdb0ad78fd9faf1f98ebf20a93dfdd00ac9e18e07a00f46"} Jul 15 14:31:57.134052 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:57.134025 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sn4mn" event={"ID":"081c09ac-5d7f-457e-b63a-354d4d4c793f","Type":"ContainerStarted","Data":"7167ccb9f8ec4fd5adf9a53fb07a7342a6362e0bd1bd922cb9b40561d7d89711"} Jul 15 14:31:57.134162 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:57.134079 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sn4mn" event={"ID":"081c09ac-5d7f-457e-b63a-354d4d4c793f","Type":"ContainerStarted","Data":"636c0665bf655fbfc720048054f7d42b8bd037d1b22861d5a954381bcc8ab8cb"} Jul 15 14:31:57.137281 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:57.136927 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" event={"ID":"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45","Type":"ContainerStarted","Data":"de2f10b2b88f474aba0440fea4cbeb67e8d1e486b1955b39cb853b53f7402b3c"} Jul 15 14:31:57.137281 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:57.136967 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" event={"ID":"6c6eabc6-a1f2-4540-bc7c-3e78ca48be45","Type":"ContainerStarted","Data":"6527b99be7970e4d339de18c498d2ce3c88bcfb9e48f5f017dba5a3685ec019e"} Jul 15 14:31:57.137281 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:57.137017 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:31:57.140056 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:57.140029 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wdhdj" event={"ID":"e5acfc7c-04db-4f37-9c8e-9476855d4508","Type":"ContainerStarted","Data":"278218426d2799db76f405fef54e83bc9b694d85957aee9198eab682ea1d591b"} Jul 15 14:31:57.140163 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:57.140080 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wdhdj" event={"ID":"e5acfc7c-04db-4f37-9c8e-9476855d4508","Type":"ContainerStarted","Data":"606fe2ff99d47e7c3231635e3d4ea4841146f1c08e57d9878c9a262b44c76c22"} Jul 15 14:31:57.140268 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:57.140253 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wdhdj" Jul 15 14:31:57.142573 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:57.142544 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jv5jr" event={"ID":"5231db67-ee3e-41f3-9cc4-8819edeedb57","Type":"ContainerStarted","Data":"d349940df807d31380843239b25395aebd5b71db6bce73029cdc31a3366096fe"} Jul 15 14:31:57.142946 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:57.142913 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:31:57.147472 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:57.147407 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ddnm2" podStartSLOduration=69.517261595 podStartE2EDuration="1m17.147389749s" totalImagesPullingTime="7.630128154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:57.145842508 +0000 UTC m=+77.018777073" watchObservedRunningTime="2026-07-15 14:31:57.147389749 +0000 UTC m=+77.020324311" Jul 15 14:31:57.166923 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:57.165868 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sn4mn" podStartSLOduration=69.52392155 podStartE2EDuration="1m17.165849937s" totalImagesPullingTime="7.641928387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:57.164274887 +0000 UTC m=+77.037209459" watchObservedRunningTime="2026-07-15 14:31:57.165849937 +0000 UTC m=+77.038784503" Jul 15 14:31:57.188978 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:57.188920 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wdhdj" podStartSLOduration=34.578382706 podStartE2EDuration="42.188896483s" totalImagesPullingTime="7.610513777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:57.186953669 +0000 UTC m=+77.059888252" watchObservedRunningTime="2026-07-15 14:31:57.188896483 +0000 UTC m=+77.061831046" Jul 15 14:31:57.237390 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:57.237301 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jv5jr" podStartSLOduration=69.581601834 podStartE2EDuration="1m17.237277389s" totalImagesPullingTime="7.655675555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:57.208795399 +0000 UTC m=+77.081729961" watchObservedRunningTime="2026-07-15 14:31:57.237277389 +0000 UTC m=+77.110211949" Jul 15 14:31:57.238232 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:31:57.238182 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" podStartSLOduration=7.238167747 podStartE2EDuration="7.238167747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:31:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:57.236934459 +0000 UTC m=+77.109869019" watchObservedRunningTime="2026-07-15 14:31:57.238167747 +0000 UTC m=+77.111102286" Jul 15 14:32:02.171146 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:02.171005 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p87cs" event={"ID":"4afda59e-88f5-4b3a-9f2e-76325ee1d636","Type":"ContainerStarted","Data":"dff4901a902bc2c2a9320170e8b5515a013d4d1f41b752251ac18b5e545a09e6"} Jul 15 14:32:02.173083 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:02.173059 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" event={"ID":"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8","Type":"ContainerStarted","Data":"3d5b59e0f42cf7cb0dbfb11abf173a76a2afb675713279cee6e818cef3e66a80"} Jul 15 14:32:02.173183 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:02.173094 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" event={"ID":"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8","Type":"ContainerStarted","Data":"1f0c126f25c417c86a4a2cd4dd76206a422932e8872d86b193c98718fd664c40"} Jul 15 14:32:02.173183 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:02.173106 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" event={"ID":"36ab2e54-2ed4-4a77-b05e-a4de437a0ad8","Type":"ContainerStarted","Data":"e498ae40236bb26c76dba7e33f00d2d5f0d95b2559d938eccf3d6087e89ccfae"} Jul 15 14:32:02.203784 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:02.203733 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p87cs" podStartSLOduration=17.537736649 podStartE2EDuration="36.203716747s" totalImagesPullingTime="18.665980098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:31:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:02.202118274 +0000 UTC m=+82.075052845" watchObservedRunningTime="2026-07-15 14:32:02.203716747 +0000 UTC m=+82.076651342" Jul 15 14:32:02.235294 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:02.235234 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67954d67c4-ltmjw" podStartSLOduration=8.136493058 podStartE2EDuration="13.235219465s" totalImagesPullingTime="5.098726407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:31:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:02.231998441 +0000 UTC m=+82.104932998" watchObservedRunningTime="2026-07-15 14:32:02.235219465 +0000 UTC m=+82.108154032" Jul 15 14:32:07.152266 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:07.152236 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wdhdj" Jul 15 14:32:08.620140 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.620110 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sw6rl"] Jul 15 14:32:08.623697 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.623676 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.629075 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.629052 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 14:32:08.630149 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.630126 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 14:32:08.630149 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.630142 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 14:32:08.630312 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.630202 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9xfhr\"" Jul 15 14:32:08.630312 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.630138 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 14:32:08.630674 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.630657 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 14:32:08.630740 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.630672 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 14:32:08.798994 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.798953 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-node-exporter-tls\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.799164 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.799000 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-root\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.799164 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.799039 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-node-exporter-wtmp\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.799164 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.799063 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r94nw\" (UniqueName: \"kubernetes.io/projected/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-kube-api-access-r94nw\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.799164 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.799086 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.799164 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.799104 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-node-exporter-textfile\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.799321 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.799172 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-sys\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.799321 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.799234 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-metrics-client-ca\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.799321 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.799258 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.899812 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.899781 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-node-exporter-tls\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.899919 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.899843 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-root\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.899919 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.899872 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-node-exporter-wtmp\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.899919 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.899889 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r94nw\" (UniqueName: \"kubernetes.io/projected/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-kube-api-access-r94nw\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.899919 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.899901 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-root\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.900137 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.899910 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.900137 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.899959 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-node-exporter-textfile\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.900137 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.899988 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-sys\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.900137 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.900012 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-metrics-client-ca\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.900137 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.900029 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.900137 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.900062 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-node-exporter-wtmp\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.900137 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.900101 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-sys\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.900386 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.900346 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-node-exporter-textfile\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.900546 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.900516 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.900766 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.900745 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-metrics-client-ca\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.902144 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.902127 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.902237 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.902221 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-node-exporter-tls\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.912445 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.912424 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r94nw\" (UniqueName: \"kubernetes.io/projected/2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9-kube-api-access-r94nw\") pod \"node-exporter-sw6rl\" (UID: \"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9\") " pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.932500 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:08.932483 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sw6rl" Jul 15 14:32:08.941867 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:32:08.941843 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d6bb4bd_3fbe_4c29_b0ac_041b46c699b9.slice/crio-f25c59241db4d0b253cbbed3dca65119a80ac63657c6cdccc5ad6abb4c4ca7ff WatchSource:0}: Error finding container f25c59241db4d0b253cbbed3dca65119a80ac63657c6cdccc5ad6abb4c4ca7ff: Status 404 returned error can't find the container with id f25c59241db4d0b253cbbed3dca65119a80ac63657c6cdccc5ad6abb4c4ca7ff Jul 15 14:32:09.196026 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:09.195937 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sw6rl" event={"ID":"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9","Type":"ContainerStarted","Data":"f25c59241db4d0b253cbbed3dca65119a80ac63657c6cdccc5ad6abb4c4ca7ff"} Jul 15 14:32:10.200587 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:10.200505 2565 generic.go:356] "Generic (PLEG): container finished" podID="2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9" containerID="27c6376921c2833c1300b13127ed53327ffef06733a6227d3db8ee66ce193c0e" exitCode=0 Jul 15 14:32:10.200942 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:10.200589 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sw6rl" event={"ID":"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9","Type":"ContainerDied","Data":"27c6376921c2833c1300b13127ed53327ffef06733a6227d3db8ee66ce193c0e"} Jul 15 14:32:11.210584 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:11.210546 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sw6rl" event={"ID":"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9","Type":"ContainerStarted","Data":"dba85b623b064b113586859381474628f59af2c8bbd5794f1d51dc953d61f5dc"} Jul 15 14:32:11.211084 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:11.210637 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sw6rl" event={"ID":"2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9","Type":"ContainerStarted","Data":"16cb0990b53cc24555d38c16b0262659d52dc61ad7c8dd5daee9d0ac0d3cacfc"} Jul 15 14:32:11.237772 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:11.237722 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sw6rl" podStartSLOduration=2.220192139 podStartE2EDuration="3.23770725s" totalImagesPullingTime="953.18216ms" totalInitContainerRuntime="64.332951ms" isStatefulPod=true podCreationTimestamp="2026-07-15 14:32:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:11.23692594 +0000 UTC m=+91.109860500" watchObservedRunningTime="2026-07-15 14:32:11.23770725 +0000 UTC m=+91.110641803" Jul 15 14:32:13.166839 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.166789 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-847bc7dc4b-qgjnh"] Jul 15 14:32:13.169037 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.169022 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.171703 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.171681 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8i1rqrlbnsr55\"" Jul 15 14:32:13.172543 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.172525 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 15 14:32:13.172672 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.172652 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 15 14:32:13.172736 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.172674 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 15 14:32:13.172736 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.172710 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 15 14:32:13.172841 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.172758 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7t75p\"" Jul 15 14:32:13.192932 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.192907 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-847bc7dc4b-qgjnh"] Jul 15 14:32:13.330665 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.330631 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/02b44e5c-0857-4b99-9182-74267fa3f19e-secret-metrics-server-client-certs\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.330844 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.330685 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02b44e5c-0857-4b99-9182-74267fa3f19e-client-ca-bundle\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.330844 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.330747 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/02b44e5c-0857-4b99-9182-74267fa3f19e-audit-log\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.330844 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.330773 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/02b44e5c-0857-4b99-9182-74267fa3f19e-metrics-server-audit-profiles\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.330844 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.330829 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85mbp\" (UniqueName: \"kubernetes.io/projected/02b44e5c-0857-4b99-9182-74267fa3f19e-kube-api-access-85mbp\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.331010 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.330908 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/02b44e5c-0857-4b99-9182-74267fa3f19e-secret-metrics-server-tls\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.331010 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.330956 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02b44e5c-0857-4b99-9182-74267fa3f19e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.432021 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.431929 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/02b44e5c-0857-4b99-9182-74267fa3f19e-secret-metrics-server-tls\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.432021 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.431971 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02b44e5c-0857-4b99-9182-74267fa3f19e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.432021 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.432000 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/02b44e5c-0857-4b99-9182-74267fa3f19e-secret-metrics-server-client-certs\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.432021 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.432019 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02b44e5c-0857-4b99-9182-74267fa3f19e-client-ca-bundle\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.432346 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.432043 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/02b44e5c-0857-4b99-9182-74267fa3f19e-audit-log\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.432346 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.432058 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/02b44e5c-0857-4b99-9182-74267fa3f19e-metrics-server-audit-profiles\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.432346 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.432082 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85mbp\" (UniqueName: \"kubernetes.io/projected/02b44e5c-0857-4b99-9182-74267fa3f19e-kube-api-access-85mbp\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.432601 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.432572 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/02b44e5c-0857-4b99-9182-74267fa3f19e-audit-log\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.432846 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.432796 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02b44e5c-0857-4b99-9182-74267fa3f19e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.433048 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.433030 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/02b44e5c-0857-4b99-9182-74267fa3f19e-metrics-server-audit-profiles\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.434489 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.434467 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02b44e5c-0857-4b99-9182-74267fa3f19e-client-ca-bundle\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.434608 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.434490 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/02b44e5c-0857-4b99-9182-74267fa3f19e-secret-metrics-server-tls\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.434688 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.434669 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/02b44e5c-0857-4b99-9182-74267fa3f19e-secret-metrics-server-client-certs\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.441720 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.441697 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85mbp\" (UniqueName: \"kubernetes.io/projected/02b44e5c-0857-4b99-9182-74267fa3f19e-kube-api-access-85mbp\") pod \"metrics-server-847bc7dc4b-qgjnh\" (UID: \"02b44e5c-0857-4b99-9182-74267fa3f19e\") " pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.477488 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.477461 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:13.601787 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:13.601754 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-847bc7dc4b-qgjnh"] Jul 15 14:32:13.605138 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:32:13.605115 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02b44e5c_0857_4b99_9182_74267fa3f19e.slice/crio-8df1017e0c7be854ab1165c1fe958828c84df0c877a6675d05c036c7a3545192 WatchSource:0}: Error finding container 8df1017e0c7be854ab1165c1fe958828c84df0c877a6675d05c036c7a3545192: Status 404 returned error can't find the container with id 8df1017e0c7be854ab1165c1fe958828c84df0c877a6675d05c036c7a3545192 Jul 15 14:32:14.222647 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.222610 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" event={"ID":"02b44e5c-0857-4b99-9182-74267fa3f19e","Type":"ContainerStarted","Data":"8df1017e0c7be854ab1165c1fe958828c84df0c877a6675d05c036c7a3545192"} Jul 15 14:32:14.947557 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.947526 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 14:32:14.950314 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.950289 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:14.967239 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.967214 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 15 14:32:14.967394 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.967366 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 15 14:32:14.967538 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.967516 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 15 14:32:14.967653 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.967538 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 15 14:32:14.967653 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.967550 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 15 14:32:14.967653 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.967611 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 15 14:32:14.967653 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.967542 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-15mqfmpfecc7l\"" Jul 15 14:32:14.967653 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.967651 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xkt5p\"" Jul 15 14:32:14.968013 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.967744 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 15 14:32:14.968013 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.967921 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 15 14:32:14.968175 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.968159 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 15 14:32:14.968253 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.968173 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 15 14:32:14.968253 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.968234 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 15 14:32:14.968534 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.968486 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 15 14:32:14.968534 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.968489 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 15 14:32:14.968687 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.968547 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 15 14:32:14.983117 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:14.983093 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 14:32:15.043755 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.043719 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80e0e945-8d7e-4d38-8b21-60f129341833-config-out\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.043932 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.043762 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-web-config\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.043932 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.043784 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.043932 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.043860 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.043932 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.043909 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80e0e945-8d7e-4d38-8b21-60f129341833-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.044122 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.043941 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.044122 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.043993 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h86sp\" (UniqueName: \"kubernetes.io/projected/80e0e945-8d7e-4d38-8b21-60f129341833-kube-api-access-h86sp\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.044122 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.044038 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.044122 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.044067 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.044122 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.044094 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.044353 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.044133 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-config\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.044353 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.044172 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.044353 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.044205 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.044353 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.044229 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.044353 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.044258 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.044353 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.044285 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.044353 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.044310 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.044353 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.044341 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.044668 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.044376 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.044668 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.044406 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.145485 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.145450 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80e0e945-8d7e-4d38-8b21-60f129341833-config-out\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.145683 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.145502 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-web-config\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.145683 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.145533 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.145683 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.145567 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.145683 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.145598 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80e0e945-8d7e-4d38-8b21-60f129341833-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.145683 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.145619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.146020 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.145711 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h86sp\" (UniqueName: \"kubernetes.io/projected/80e0e945-8d7e-4d38-8b21-60f129341833-kube-api-access-h86sp\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.146020 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.145768 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.146020 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.145797 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.146020 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.145844 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.146020 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.145869 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-config\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.146020 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.145896 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.146020 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.145929 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.146020 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.145955 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.146020 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.145983 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.146020 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.146014 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.146502 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.146044 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.146502 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.146079 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.146502 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.146113 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.146502 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.146149 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.146502 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.146389 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.146758 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.146517 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.146758 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.146687 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.147070 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.146934 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.147651 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.147626 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.149178 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.149156 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.150119 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.149767 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.150119 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.149983 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80e0e945-8d7e-4d38-8b21-60f129341833-config-out\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.151002 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.150267 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-web-config\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.151002 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.150455 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.151002 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.150965 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-config\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.151587 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.151563 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.151913 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.151884 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80e0e945-8d7e-4d38-8b21-60f129341833-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.151913 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.151906 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.152062 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.152006 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.152240 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.152193 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.153068 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.153043 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.154169 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.154147 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.154328 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.154305 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.161394 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.161365 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h86sp\" (UniqueName: \"kubernetes.io/projected/80e0e945-8d7e-4d38-8b21-60f129341833-kube-api-access-h86sp\") pod \"prometheus-k8s-0\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.261395 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.261320 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:15.420404 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:15.420180 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 14:32:15.425125 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:32:15.425101 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80e0e945_8d7e_4d38_8b21_60f129341833.slice/crio-c4ca4a942e2b233dc09bd4cd25b075b88186b41a17d3b27d12bbe131706add51 WatchSource:0}: Error finding container c4ca4a942e2b233dc09bd4cd25b075b88186b41a17d3b27d12bbe131706add51: Status 404 returned error can't find the container with id c4ca4a942e2b233dc09bd4cd25b075b88186b41a17d3b27d12bbe131706add51 Jul 15 14:32:16.233144 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:16.233059 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" event={"ID":"02b44e5c-0857-4b99-9182-74267fa3f19e","Type":"ContainerStarted","Data":"b02f65287a6a7f7be1f28d5a7923f8cf6bfd92d5ca71118b72f70bd3322952fa"} Jul 15 14:32:16.234548 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:16.234516 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80e0e945-8d7e-4d38-8b21-60f129341833","Type":"ContainerStarted","Data":"c4ca4a942e2b233dc09bd4cd25b075b88186b41a17d3b27d12bbe131706add51"} Jul 15 14:32:16.253319 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:16.253268 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" podStartSLOduration=1.5833487000000002 podStartE2EDuration="3.253252486s" totalImagesPullingTime="1.669903786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:32:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:16.252015231 +0000 UTC m=+96.124949796" watchObservedRunningTime="2026-07-15 14:32:16.253252486 +0000 UTC m=+96.126187045" Jul 15 14:32:17.240168 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:17.240132 2565 generic.go:356] "Generic (PLEG): container finished" podID="80e0e945-8d7e-4d38-8b21-60f129341833" containerID="4815ef662611ce34b2840a84b78e0a75531915a6e1c9a211e4924cf2924b1cbd" exitCode=0 Jul 15 14:32:17.240532 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:17.240225 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80e0e945-8d7e-4d38-8b21-60f129341833","Type":"ContainerDied","Data":"4815ef662611ce34b2840a84b78e0a75531915a6e1c9a211e4924cf2924b1cbd"} Jul 15 14:32:18.155165 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:18.155132 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" Jul 15 14:32:21.258657 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:21.258573 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80e0e945-8d7e-4d38-8b21-60f129341833","Type":"ContainerStarted","Data":"8d03806e7c758655f7e21fe788f91971e8ef984e6ff05d269a7b9c8400c21e03"} Jul 15 14:32:21.258657 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:21.258638 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80e0e945-8d7e-4d38-8b21-60f129341833","Type":"ContainerStarted","Data":"cbcfd6b5baafc03ee9fb7c0faef90d453c21a2ab73585e2816eb5e75fe5f5ced"} Jul 15 14:32:23.270490 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:23.270401 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80e0e945-8d7e-4d38-8b21-60f129341833","Type":"ContainerStarted","Data":"3d12b9388c43559d86796c8e56eecface1b2e0b623366b85ff72036ee3bcb477"} Jul 15 14:32:23.270883 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:23.270522 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80e0e945-8d7e-4d38-8b21-60f129341833","Type":"ContainerStarted","Data":"cabab4220b2c43562b14e185fb48b4343a240ffd8c244dba7fe3db46bc5ae84b"} Jul 15 14:32:23.270883 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:23.270570 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80e0e945-8d7e-4d38-8b21-60f129341833","Type":"ContainerStarted","Data":"4746508c77a9de903636cd5015d14da136f5c578e58fc0a7effcb2eb6f342934"} Jul 15 14:32:23.270883 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:23.270606 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80e0e945-8d7e-4d38-8b21-60f129341833","Type":"ContainerStarted","Data":"b7454fefb5d24a341bf5bf2b4af5a5c6b1f55d232c0b9d2c467dd34a4f6c2200"} Jul 15 14:32:23.310956 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:23.310876 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.461925391 podStartE2EDuration="9.310857005s" totalImagesPullingTime="6.827543279s" totalInitContainerRuntime="21.388335ms" isStatefulPod=false podCreationTimestamp="2026-07-15 14:32:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:23.31054366 +0000 UTC m=+103.183478222" watchObservedRunningTime="2026-07-15 14:32:23.310857005 +0000 UTC m=+103.183791566" Jul 15 14:32:25.261847 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:25.261795 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:32:28.151949 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:28.151918 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jv5jr" Jul 15 14:32:33.478605 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:33.478562 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:33.479139 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:33.478641 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:53.483011 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:53.482981 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:32:53.486755 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:32:53.486730 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-847bc7dc4b-qgjnh" Jul 15 14:33:15.261486 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:15.261445 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:15.281065 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:15.281037 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:15.467106 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:15.467074 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:33.347127 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.347047 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 14:33:33.347559 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.347358 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="prometheus" containerID="cri-o://cbcfd6b5baafc03ee9fb7c0faef90d453c21a2ab73585e2816eb5e75fe5f5ced" gracePeriod=600 Jul 15 14:33:33.347559 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.347397 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="kube-rbac-proxy" containerID="cri-o://cabab4220b2c43562b14e185fb48b4343a240ffd8c244dba7fe3db46bc5ae84b" gracePeriod=600 Jul 15 14:33:33.347559 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.347427 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3d12b9388c43559d86796c8e56eecface1b2e0b623366b85ff72036ee3bcb477" gracePeriod=600 Jul 15 14:33:33.347559 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.347457 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="kube-rbac-proxy-web" containerID="cri-o://4746508c77a9de903636cd5015d14da136f5c578e58fc0a7effcb2eb6f342934" gracePeriod=600 Jul 15 14:33:33.347559 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.347427 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="thanos-sidecar" containerID="cri-o://b7454fefb5d24a341bf5bf2b4af5a5c6b1f55d232c0b9d2c467dd34a4f6c2200" gracePeriod=600 Jul 15 14:33:33.347559 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.347455 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="config-reloader" containerID="cri-o://8d03806e7c758655f7e21fe788f91971e8ef984e6ff05d269a7b9c8400c21e03" gracePeriod=600 Jul 15 14:33:33.521195 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.521167 2565 generic.go:356] "Generic (PLEG): container finished" podID="80e0e945-8d7e-4d38-8b21-60f129341833" containerID="3d12b9388c43559d86796c8e56eecface1b2e0b623366b85ff72036ee3bcb477" exitCode=0 Jul 15 14:33:33.521195 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.521191 2565 generic.go:356] "Generic (PLEG): container finished" podID="80e0e945-8d7e-4d38-8b21-60f129341833" containerID="cabab4220b2c43562b14e185fb48b4343a240ffd8c244dba7fe3db46bc5ae84b" exitCode=0 Jul 15 14:33:33.521195 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.521197 2565 generic.go:356] "Generic (PLEG): container finished" podID="80e0e945-8d7e-4d38-8b21-60f129341833" containerID="4746508c77a9de903636cd5015d14da136f5c578e58fc0a7effcb2eb6f342934" exitCode=0 Jul 15 14:33:33.521374 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.521202 2565 generic.go:356] "Generic (PLEG): container finished" podID="80e0e945-8d7e-4d38-8b21-60f129341833" containerID="b7454fefb5d24a341bf5bf2b4af5a5c6b1f55d232c0b9d2c467dd34a4f6c2200" exitCode=0 Jul 15 14:33:33.521374 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.521207 2565 generic.go:356] "Generic (PLEG): container finished" podID="80e0e945-8d7e-4d38-8b21-60f129341833" containerID="8d03806e7c758655f7e21fe788f91971e8ef984e6ff05d269a7b9c8400c21e03" exitCode=0 Jul 15 14:33:33.521374 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.521212 2565 generic.go:356] "Generic (PLEG): container finished" podID="80e0e945-8d7e-4d38-8b21-60f129341833" containerID="cbcfd6b5baafc03ee9fb7c0faef90d453c21a2ab73585e2816eb5e75fe5f5ced" exitCode=0 Jul 15 14:33:33.521374 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.521247 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80e0e945-8d7e-4d38-8b21-60f129341833","Type":"ContainerDied","Data":"3d12b9388c43559d86796c8e56eecface1b2e0b623366b85ff72036ee3bcb477"} Jul 15 14:33:33.521374 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.521338 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80e0e945-8d7e-4d38-8b21-60f129341833","Type":"ContainerDied","Data":"cabab4220b2c43562b14e185fb48b4343a240ffd8c244dba7fe3db46bc5ae84b"} Jul 15 14:33:33.521520 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.521389 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80e0e945-8d7e-4d38-8b21-60f129341833","Type":"ContainerDied","Data":"4746508c77a9de903636cd5015d14da136f5c578e58fc0a7effcb2eb6f342934"} Jul 15 14:33:33.521520 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.521433 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80e0e945-8d7e-4d38-8b21-60f129341833","Type":"ContainerDied","Data":"b7454fefb5d24a341bf5bf2b4af5a5c6b1f55d232c0b9d2c467dd34a4f6c2200"} Jul 15 14:33:33.521520 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.521474 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80e0e945-8d7e-4d38-8b21-60f129341833","Type":"ContainerDied","Data":"8d03806e7c758655f7e21fe788f91971e8ef984e6ff05d269a7b9c8400c21e03"} Jul 15 14:33:33.521520 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.521515 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80e0e945-8d7e-4d38-8b21-60f129341833","Type":"ContainerDied","Data":"cbcfd6b5baafc03ee9fb7c0faef90d453c21a2ab73585e2816eb5e75fe5f5ced"} Jul 15 14:33:33.596299 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.596267 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:33.666575 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.666542 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-grpc-tls\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.666747 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.666588 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.666747 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.666619 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-kube-rbac-proxy\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.666747 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.666648 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-configmap-kubelet-serving-ca-bundle\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.666747 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.666679 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-web-config\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.666747 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.666703 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-thanos-prometheus-http-client-file\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.666747 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.666729 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80e0e945-8d7e-4d38-8b21-60f129341833-config-out\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.667081 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.666755 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h86sp\" (UniqueName: \"kubernetes.io/projected/80e0e945-8d7e-4d38-8b21-60f129341833-kube-api-access-h86sp\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.667081 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.666785 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-trusted-ca-bundle\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.667081 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.666828 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-db\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.667081 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.666867 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-prometheus-k8s-tls\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.667081 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.666893 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.667081 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.666922 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-rulefiles-1\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.667081 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.666954 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80e0e945-8d7e-4d38-8b21-60f129341833-tls-assets\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.667081 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.666977 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-configmap-serving-certs-ca-bundle\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.667081 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.667002 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-rulefiles-0\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.667081 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.667031 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-metrics-client-certs\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.667081 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.667063 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-configmap-metrics-client-ca\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.667617 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.667092 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-rulefiles-2\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.667617 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.667122 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-config\") pod \"80e0e945-8d7e-4d38-8b21-60f129341833\" (UID: \"80e0e945-8d7e-4d38-8b21-60f129341833\") " Jul 15 14:33:33.667617 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.667378 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:33:33.667778 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.667635 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:33:33.667890 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.667863 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:33:33.668288 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.668258 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:33:33.669668 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.669631 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:33:33.670104 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.670081 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:33:33.670582 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.670544 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:33:33.671573 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.671533 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:33:33.672197 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.672153 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 14:33:33.672343 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.672304 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 14:33:33.672418 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.672390 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 14:33:33.672604 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.672583 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80e0e945-8d7e-4d38-8b21-60f129341833-config-out" (OuterVolumeSpecName: "config-out") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:33:33.672672 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.672606 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 14:33:33.673330 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.673303 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 14:33:33.673330 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.673319 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 14:33:33.673487 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.673391 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 14:33:33.673487 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.673441 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80e0e945-8d7e-4d38-8b21-60f129341833-kube-api-access-h86sp" (OuterVolumeSpecName: "kube-api-access-h86sp") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "kube-api-access-h86sp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 14:33:33.673607 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.673591 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80e0e945-8d7e-4d38-8b21-60f129341833-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 14:33:33.674155 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.674138 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-config" (OuterVolumeSpecName: "config") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 14:33:33.682590 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.682569 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-web-config" (OuterVolumeSpecName: "web-config") pod "80e0e945-8d7e-4d38-8b21-60f129341833" (UID: "80e0e945-8d7e-4d38-8b21-60f129341833"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 14:33:33.768326 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768289 2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-grpc-tls\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:33.768326 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768316 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:33.768326 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768328 2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-kube-rbac-proxy\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:33.768326 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768337 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:33.768591 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768346 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-web-config\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:33.768591 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768355 2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:33.768591 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768363 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80e0e945-8d7e-4d38-8b21-60f129341833-config-out\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:33.768591 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768372 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h86sp\" (UniqueName: \"kubernetes.io/projected/80e0e945-8d7e-4d38-8b21-60f129341833-kube-api-access-h86sp\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:33.768591 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768380 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:33.768591 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768389 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-db\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:33.768591 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768398 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:33.768591 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768409 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:33.768591 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768417 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:33.768591 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768425 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80e0e945-8d7e-4d38-8b21-60f129341833-tls-assets\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:33.768591 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768433 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:33.768591 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768442 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:33.768591 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768450 2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-secret-metrics-client-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:33.768591 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768458 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-configmap-metrics-client-ca\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:33.768591 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768467 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80e0e945-8d7e-4d38-8b21-60f129341833-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:33.768591 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:33.768476 2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/80e0e945-8d7e-4d38-8b21-60f129341833-config\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 14:33:34.528157 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.528124 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80e0e945-8d7e-4d38-8b21-60f129341833","Type":"ContainerDied","Data":"c4ca4a942e2b233dc09bd4cd25b075b88186b41a17d3b27d12bbe131706add51"} Jul 15 14:33:34.528535 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.528199 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.528535 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.528230 2565 scope.go:117] "RemoveContainer" containerID="3d12b9388c43559d86796c8e56eecface1b2e0b623366b85ff72036ee3bcb477" Jul 15 14:33:34.536622 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.536602 2565 scope.go:117] "RemoveContainer" containerID="cabab4220b2c43562b14e185fb48b4343a240ffd8c244dba7fe3db46bc5ae84b" Jul 15 14:33:34.543443 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.543421 2565 scope.go:117] "RemoveContainer" containerID="4746508c77a9de903636cd5015d14da136f5c578e58fc0a7effcb2eb6f342934" Jul 15 14:33:34.550124 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.550107 2565 scope.go:117] "RemoveContainer" containerID="b7454fefb5d24a341bf5bf2b4af5a5c6b1f55d232c0b9d2c467dd34a4f6c2200" Jul 15 14:33:34.551192 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.551153 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 14:33:34.556008 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.555984 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 14:33:34.557120 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.557106 2565 scope.go:117] "RemoveContainer" containerID="8d03806e7c758655f7e21fe788f91971e8ef984e6ff05d269a7b9c8400c21e03" Jul 15 14:33:34.563967 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.563949 2565 scope.go:117] "RemoveContainer" containerID="cbcfd6b5baafc03ee9fb7c0faef90d453c21a2ab73585e2816eb5e75fe5f5ced" Jul 15 14:33:34.572000 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.571983 2565 scope.go:117] "RemoveContainer" containerID="4815ef662611ce34b2840a84b78e0a75531915a6e1c9a211e4924cf2924b1cbd" Jul 15 14:33:34.585404 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585383 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 14:33:34.585635 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585622 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="thanos-sidecar" Jul 15 14:33:34.585684 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585636 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="thanos-sidecar" Jul 15 14:33:34.585684 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585643 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="kube-rbac-proxy-web" Jul 15 14:33:34.585684 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585649 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="kube-rbac-proxy-web" Jul 15 14:33:34.585684 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585674 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="config-reloader" Jul 15 14:33:34.585684 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585680 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="config-reloader" Jul 15 14:33:34.585854 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585691 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="prometheus" Jul 15 14:33:34.585854 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585697 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="prometheus" Jul 15 14:33:34.585854 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585703 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="kube-rbac-proxy" Jul 15 14:33:34.585854 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585708 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="kube-rbac-proxy" Jul 15 14:33:34.585854 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585714 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="init-config-reloader" Jul 15 14:33:34.585854 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585719 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="init-config-reloader" Jul 15 14:33:34.585854 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585726 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="kube-rbac-proxy-thanos" Jul 15 14:33:34.585854 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585731 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="kube-rbac-proxy-thanos" Jul 15 14:33:34.585854 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585776 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="thanos-sidecar" Jul 15 14:33:34.585854 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585782 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="kube-rbac-proxy-thanos" Jul 15 14:33:34.585854 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585789 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="prometheus" Jul 15 14:33:34.585854 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585794 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="config-reloader" Jul 15 14:33:34.585854 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585800 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="kube-rbac-proxy-web" Jul 15 14:33:34.585854 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.585820 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" containerName="kube-rbac-proxy" Jul 15 14:33:34.588537 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.588522 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.591083 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.591057 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 15 14:33:34.591223 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.591208 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 15 14:33:34.591494 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.591450 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 15 14:33:34.591494 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.591463 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 15 14:33:34.591494 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.591457 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 15 14:33:34.591494 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.591493 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 15 14:33:34.591717 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.591506 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 15 14:33:34.591717 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.591457 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 15 14:33:34.591717 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.591463 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-15mqfmpfecc7l\"" Jul 15 14:33:34.591865 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.591741 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xkt5p\"" Jul 15 14:33:34.591865 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.591846 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 15 14:33:34.592632 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.592605 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 15 14:33:34.592688 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.592609 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 15 14:33:34.592688 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.592663 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 15 14:33:34.595771 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.595753 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 15 14:33:34.598028 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.598013 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 15 14:33:34.611521 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.611460 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 14:33:34.676708 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.676667 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-config\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.676708 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.676711 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.676941 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.676750 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.676941 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.676779 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10f6ea4d-24ad-4390-9371-109812fbfa8b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.676941 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.676846 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10f6ea4d-24ad-4390-9371-109812fbfa8b-config-out\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.676941 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.676871 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.676941 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.676886 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.676941 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.676930 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.677159 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.676967 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-web-config\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.677159 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.677000 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.677159 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.677034 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.677159 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.677055 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgt8p\" (UniqueName: \"kubernetes.io/projected/10f6ea4d-24ad-4390-9371-109812fbfa8b-kube-api-access-pgt8p\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.677159 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.677089 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10f6ea4d-24ad-4390-9371-109812fbfa8b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.677159 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.677111 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.677159 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.677149 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.677470 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.677181 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.677470 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.677237 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.677470 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.677265 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.677470 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.677291 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.677470 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.677368 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.679012 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.678990 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80e0e945-8d7e-4d38-8b21-60f129341833" path="/var/lib/kubelet/pods/80e0e945-8d7e-4d38-8b21-60f129341833/volumes" Jul 15 14:33:34.777911 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.777877 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-config\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.777911 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.777911 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.778158 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.777933 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.778158 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.777955 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10f6ea4d-24ad-4390-9371-109812fbfa8b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.778158 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.777970 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10f6ea4d-24ad-4390-9371-109812fbfa8b-config-out\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.778158 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.777986 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.778158 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.778028 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.778158 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.778077 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.778158 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.778106 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-web-config\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.778158 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.778138 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.778526 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.778174 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.778526 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.778220 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgt8p\" (UniqueName: \"kubernetes.io/projected/10f6ea4d-24ad-4390-9371-109812fbfa8b-kube-api-access-pgt8p\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.778526 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.778262 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10f6ea4d-24ad-4390-9371-109812fbfa8b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.778526 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.778287 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.778526 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.778317 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.778526 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.778347 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.778526 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.778379 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.778526 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.778410 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.778526 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.778444 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.778526 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.778481 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10f6ea4d-24ad-4390-9371-109812fbfa8b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.778526 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.778491 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.779438 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.778679 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.779438 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.779036 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.779438 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.779384 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.779643 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.779619 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.779800 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.779696 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.780195 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.780167 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.782788 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.781339 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-config\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.782788 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.782015 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-web-config\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.782788 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.782351 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.782788 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.782695 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.782788 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.782693 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.782788 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.782735 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.783180 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.782904 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10f6ea4d-24ad-4390-9371-109812fbfa8b-config-out\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.783613 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.783585 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.783613 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.783605 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10f6ea4d-24ad-4390-9371-109812fbfa8b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.783719 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.783667 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.784130 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.784108 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10f6ea4d-24ad-4390-9371-109812fbfa8b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.784578 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.784563 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10f6ea4d-24ad-4390-9371-109812fbfa8b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.786654 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.786633 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgt8p\" (UniqueName: \"kubernetes.io/projected/10f6ea4d-24ad-4390-9371-109812fbfa8b-kube-api-access-pgt8p\") pod \"prometheus-k8s-0\" (UID: \"10f6ea4d-24ad-4390-9371-109812fbfa8b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:34.898267 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:34.898233 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:33:35.034221 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:35.034186 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 14:33:35.037649 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:33:35.037618 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f6ea4d_24ad_4390_9371_109812fbfa8b.slice/crio-51c74d7445c5beb75367a471540ed9c7ea5762bd4a4d11f394ab3c05969007eb WatchSource:0}: Error finding container 51c74d7445c5beb75367a471540ed9c7ea5762bd4a4d11f394ab3c05969007eb: Status 404 returned error can't find the container with id 51c74d7445c5beb75367a471540ed9c7ea5762bd4a4d11f394ab3c05969007eb Jul 15 14:33:35.533943 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:35.533904 2565 generic.go:356] "Generic (PLEG): container finished" podID="10f6ea4d-24ad-4390-9371-109812fbfa8b" containerID="f5ed475e1f6e60484c21c6df0bb4e4d80231362dbb146ae51bc7fad104f8d2c2" exitCode=0 Jul 15 14:33:35.534397 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:35.533970 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10f6ea4d-24ad-4390-9371-109812fbfa8b","Type":"ContainerDied","Data":"f5ed475e1f6e60484c21c6df0bb4e4d80231362dbb146ae51bc7fad104f8d2c2"} Jul 15 14:33:35.534397 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:35.534040 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10f6ea4d-24ad-4390-9371-109812fbfa8b","Type":"ContainerStarted","Data":"51c74d7445c5beb75367a471540ed9c7ea5762bd4a4d11f394ab3c05969007eb"} Jul 15 14:33:36.541202 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:36.541162 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10f6ea4d-24ad-4390-9371-109812fbfa8b","Type":"ContainerStarted","Data":"499db8d9faf36480924b6a7e521616ae8001c5e6113fa74ecbc345da7e9dc75a"} Jul 15 14:33:36.541559 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:36.541227 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10f6ea4d-24ad-4390-9371-109812fbfa8b","Type":"ContainerStarted","Data":"e1d7ef1e2a47645fe7a07dbeef821beeecff5a7bfbf1d5bff4f470e48da95922"} Jul 15 14:33:36.541559 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:36.541255 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10f6ea4d-24ad-4390-9371-109812fbfa8b","Type":"ContainerStarted","Data":"70c32c64f9d40eb0eb160c36735c740128541a4f518fda2416d3178f0afadbd2"} Jul 15 14:33:36.541559 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:36.541282 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10f6ea4d-24ad-4390-9371-109812fbfa8b","Type":"ContainerStarted","Data":"5be54dbe0ae7846381a8102209281012914f9212c7f847f4c255faf4f019e9de"} Jul 15 14:33:36.541559 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:36.541305 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10f6ea4d-24ad-4390-9371-109812fbfa8b","Type":"ContainerStarted","Data":"f9a31d45b1852e7df78a7449b9f1e4bc09ddd715f43b09b4cc478e006268b620"} Jul 15 14:33:36.541559 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:36.541328 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10f6ea4d-24ad-4390-9371-109812fbfa8b","Type":"ContainerStarted","Data":"899f1e0c2fb86f017d757ef9168ffbe95457186a39df299ed94518ac10d8d2b3"} Jul 15 14:33:36.571985 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:36.571931 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.551591709 podStartE2EDuration="2.571913291s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.321582ms" isStatefulPod=false podCreationTimestamp="2026-07-15 14:33:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:33:36.57057577 +0000 UTC m=+176.443510330" watchObservedRunningTime="2026-07-15 14:33:36.571913291 +0000 UTC m=+176.444847851" Jul 15 14:33:39.899118 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:33:39.899064 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:34:34.898870 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:34:34.898797 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:34:34.913797 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:34:34.913771 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:34:35.759666 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:34:35.759636 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 14:35:40.513976 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:35:40.513945 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 14:38:35.093411 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.093378 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk"] Jul 15 14:38:35.096571 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.096552 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" Jul 15 14:38:35.099529 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.099510 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 14:38:35.099787 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.099774 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kcdzw\"" Jul 15 14:38:35.101024 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.101009 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 14:38:35.101175 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.101157 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 14:38:35.102085 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.102070 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 14:38:35.120753 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.120721 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk"] Jul 15 14:38:35.191322 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.191291 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/980c2a86-9caf-4804-b8da-362cdc1979b0-webhook-cert\") pod \"opendatahub-operator-controller-manager-846b6d9d56-hhnkk\" (UID: \"980c2a86-9caf-4804-b8da-362cdc1979b0\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" Jul 15 14:38:35.191500 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.191340 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/980c2a86-9caf-4804-b8da-362cdc1979b0-tmp\") pod \"opendatahub-operator-controller-manager-846b6d9d56-hhnkk\" (UID: \"980c2a86-9caf-4804-b8da-362cdc1979b0\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" Jul 15 14:38:35.191500 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.191360 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dl8l\" (UniqueName: \"kubernetes.io/projected/980c2a86-9caf-4804-b8da-362cdc1979b0-kube-api-access-6dl8l\") pod \"opendatahub-operator-controller-manager-846b6d9d56-hhnkk\" (UID: \"980c2a86-9caf-4804-b8da-362cdc1979b0\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" Jul 15 14:38:35.191500 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.191427 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/980c2a86-9caf-4804-b8da-362cdc1979b0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846b6d9d56-hhnkk\" (UID: \"980c2a86-9caf-4804-b8da-362cdc1979b0\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" Jul 15 14:38:35.191500 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.191481 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/980c2a86-9caf-4804-b8da-362cdc1979b0-manifests\") pod \"opendatahub-operator-controller-manager-846b6d9d56-hhnkk\" (UID: \"980c2a86-9caf-4804-b8da-362cdc1979b0\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" Jul 15 14:38:35.292594 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.292561 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/980c2a86-9caf-4804-b8da-362cdc1979b0-webhook-cert\") pod \"opendatahub-operator-controller-manager-846b6d9d56-hhnkk\" (UID: \"980c2a86-9caf-4804-b8da-362cdc1979b0\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" Jul 15 14:38:35.292791 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.292614 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/980c2a86-9caf-4804-b8da-362cdc1979b0-tmp\") pod \"opendatahub-operator-controller-manager-846b6d9d56-hhnkk\" (UID: \"980c2a86-9caf-4804-b8da-362cdc1979b0\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" Jul 15 14:38:35.292791 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.292636 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dl8l\" (UniqueName: \"kubernetes.io/projected/980c2a86-9caf-4804-b8da-362cdc1979b0-kube-api-access-6dl8l\") pod \"opendatahub-operator-controller-manager-846b6d9d56-hhnkk\" (UID: \"980c2a86-9caf-4804-b8da-362cdc1979b0\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" Jul 15 14:38:35.292791 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.292658 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/980c2a86-9caf-4804-b8da-362cdc1979b0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846b6d9d56-hhnkk\" (UID: \"980c2a86-9caf-4804-b8da-362cdc1979b0\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" Jul 15 14:38:35.292791 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.292681 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/980c2a86-9caf-4804-b8da-362cdc1979b0-manifests\") pod \"opendatahub-operator-controller-manager-846b6d9d56-hhnkk\" (UID: \"980c2a86-9caf-4804-b8da-362cdc1979b0\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" Jul 15 14:38:35.293184 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.293162 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/980c2a86-9caf-4804-b8da-362cdc1979b0-manifests\") pod \"opendatahub-operator-controller-manager-846b6d9d56-hhnkk\" (UID: \"980c2a86-9caf-4804-b8da-362cdc1979b0\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" Jul 15 14:38:35.295021 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.294993 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/980c2a86-9caf-4804-b8da-362cdc1979b0-tmp\") pod \"opendatahub-operator-controller-manager-846b6d9d56-hhnkk\" (UID: \"980c2a86-9caf-4804-b8da-362cdc1979b0\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" Jul 15 14:38:35.295133 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.295117 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/980c2a86-9caf-4804-b8da-362cdc1979b0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846b6d9d56-hhnkk\" (UID: \"980c2a86-9caf-4804-b8da-362cdc1979b0\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" Jul 15 14:38:35.295293 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.295274 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/980c2a86-9caf-4804-b8da-362cdc1979b0-webhook-cert\") pod \"opendatahub-operator-controller-manager-846b6d9d56-hhnkk\" (UID: \"980c2a86-9caf-4804-b8da-362cdc1979b0\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" Jul 15 14:38:35.302063 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.302041 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dl8l\" (UniqueName: \"kubernetes.io/projected/980c2a86-9caf-4804-b8da-362cdc1979b0-kube-api-access-6dl8l\") pod \"opendatahub-operator-controller-manager-846b6d9d56-hhnkk\" (UID: \"980c2a86-9caf-4804-b8da-362cdc1979b0\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" Jul 15 14:38:35.406099 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.406071 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" Jul 15 14:38:35.552917 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.552885 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk"] Jul 15 14:38:35.556132 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:38:35.556105 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod980c2a86_9caf_4804_b8da_362cdc1979b0.slice/crio-829181cb28222de25a1bd9b28051b8c3bb7ecfff6988c71df607db8f0ae5e478 WatchSource:0}: Error finding container 829181cb28222de25a1bd9b28051b8c3bb7ecfff6988c71df607db8f0ae5e478: Status 404 returned error can't find the container with id 829181cb28222de25a1bd9b28051b8c3bb7ecfff6988c71df607db8f0ae5e478 Jul 15 14:38:35.557925 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.557908 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 14:38:35.580655 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:35.580626 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" event={"ID":"980c2a86-9caf-4804-b8da-362cdc1979b0","Type":"ContainerStarted","Data":"829181cb28222de25a1bd9b28051b8c3bb7ecfff6988c71df607db8f0ae5e478"} Jul 15 14:38:39.596970 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:39.596864 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" event={"ID":"980c2a86-9caf-4804-b8da-362cdc1979b0","Type":"ContainerStarted","Data":"bc8c9a60def7f5238962face46842440172c15d0a2e3436ad0b543ac27fc35c0"} Jul 15 14:38:40.601832 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:40.601728 2565 generic.go:356] "Generic (PLEG): container finished" podID="980c2a86-9caf-4804-b8da-362cdc1979b0" containerID="bc8c9a60def7f5238962face46842440172c15d0a2e3436ad0b543ac27fc35c0" exitCode=0 Jul 15 14:38:40.601832 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:40.601781 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" event={"ID":"980c2a86-9caf-4804-b8da-362cdc1979b0","Type":"ContainerDied","Data":"bc8c9a60def7f5238962face46842440172c15d0a2e3436ad0b543ac27fc35c0"} Jul 15 14:38:41.607243 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:41.607155 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" event={"ID":"980c2a86-9caf-4804-b8da-362cdc1979b0","Type":"ContainerStarted","Data":"843c2401f505a17666d55fd2e0930bd1d853b8f011a59bd3f2d9e5fcba46d55a"} Jul 15 14:38:41.607594 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:41.607283 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" Jul 15 14:38:41.644225 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:41.644177 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" podStartSLOduration=1.274820082 podStartE2EDuration="6.644159599s" totalImagesPullingTime="4.327053848s" totalInitContainerRuntime="1.042285669s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:38:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:38:41.643415066 +0000 UTC m=+481.516349625" watchObservedRunningTime="2026-07-15 14:38:41.644159599 +0000 UTC m=+481.517094158" Jul 15 14:38:52.613532 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:38:52.613499 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-hhnkk" Jul 15 14:39:04.350920 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.350883 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4"] Jul 15 14:39:04.353737 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.353717 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4" Jul 15 14:39:04.364979 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.364962 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 14:39:04.365518 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.365495 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 14:39:04.366075 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.366056 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n5c6n\"" Jul 15 14:39:04.366179 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.366095 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 15 14:39:04.366179 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.366096 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 15 14:39:04.366179 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.366096 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 15 14:39:04.387855 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.387819 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4"] Jul 15 14:39:04.430952 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.430919 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b7e96ebf-e571-442c-ae48-048cb234d8cd-manager-config\") pod \"lws-controller-manager-7bbc4984f8-cfng4\" (UID: \"b7e96ebf-e571-442c-ae48-048cb234d8cd\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4" Jul 15 14:39:04.431150 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.430960 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7e96ebf-e571-442c-ae48-048cb234d8cd-cert\") pod \"lws-controller-manager-7bbc4984f8-cfng4\" (UID: \"b7e96ebf-e571-442c-ae48-048cb234d8cd\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4" Jul 15 14:39:04.431150 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.431031 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b7e96ebf-e571-442c-ae48-048cb234d8cd-metrics-cert\") pod \"lws-controller-manager-7bbc4984f8-cfng4\" (UID: \"b7e96ebf-e571-442c-ae48-048cb234d8cd\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4" Jul 15 14:39:04.431150 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.431100 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gdhz\" (UniqueName: \"kubernetes.io/projected/b7e96ebf-e571-442c-ae48-048cb234d8cd-kube-api-access-8gdhz\") pod \"lws-controller-manager-7bbc4984f8-cfng4\" (UID: \"b7e96ebf-e571-442c-ae48-048cb234d8cd\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4" Jul 15 14:39:04.532161 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.532127 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b7e96ebf-e571-442c-ae48-048cb234d8cd-metrics-cert\") pod \"lws-controller-manager-7bbc4984f8-cfng4\" (UID: \"b7e96ebf-e571-442c-ae48-048cb234d8cd\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4" Jul 15 14:39:04.532365 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.532197 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gdhz\" (UniqueName: \"kubernetes.io/projected/b7e96ebf-e571-442c-ae48-048cb234d8cd-kube-api-access-8gdhz\") pod \"lws-controller-manager-7bbc4984f8-cfng4\" (UID: \"b7e96ebf-e571-442c-ae48-048cb234d8cd\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4" Jul 15 14:39:04.532365 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.532264 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b7e96ebf-e571-442c-ae48-048cb234d8cd-manager-config\") pod \"lws-controller-manager-7bbc4984f8-cfng4\" (UID: \"b7e96ebf-e571-442c-ae48-048cb234d8cd\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4" Jul 15 14:39:04.532365 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.532290 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7e96ebf-e571-442c-ae48-048cb234d8cd-cert\") pod \"lws-controller-manager-7bbc4984f8-cfng4\" (UID: \"b7e96ebf-e571-442c-ae48-048cb234d8cd\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4" Jul 15 14:39:04.532979 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.532948 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b7e96ebf-e571-442c-ae48-048cb234d8cd-manager-config\") pod \"lws-controller-manager-7bbc4984f8-cfng4\" (UID: \"b7e96ebf-e571-442c-ae48-048cb234d8cd\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4" Jul 15 14:39:04.534717 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.534695 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7e96ebf-e571-442c-ae48-048cb234d8cd-cert\") pod \"lws-controller-manager-7bbc4984f8-cfng4\" (UID: \"b7e96ebf-e571-442c-ae48-048cb234d8cd\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4" Jul 15 14:39:04.534835 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.534768 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b7e96ebf-e571-442c-ae48-048cb234d8cd-metrics-cert\") pod \"lws-controller-manager-7bbc4984f8-cfng4\" (UID: \"b7e96ebf-e571-442c-ae48-048cb234d8cd\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4" Jul 15 14:39:04.558407 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.558373 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gdhz\" (UniqueName: \"kubernetes.io/projected/b7e96ebf-e571-442c-ae48-048cb234d8cd-kube-api-access-8gdhz\") pod \"lws-controller-manager-7bbc4984f8-cfng4\" (UID: \"b7e96ebf-e571-442c-ae48-048cb234d8cd\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4" Jul 15 14:39:04.662160 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.662125 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4" Jul 15 14:39:04.831495 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:04.831460 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4"] Jul 15 14:39:04.840964 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:39:04.840937 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e96ebf_e571_442c_ae48_048cb234d8cd.slice/crio-c8cac0f0e56ca94bfc1fa06cb0a95f39f74da5b15d820391203c6366add668df WatchSource:0}: Error finding container c8cac0f0e56ca94bfc1fa06cb0a95f39f74da5b15d820391203c6366add668df: Status 404 returned error can't find the container with id c8cac0f0e56ca94bfc1fa06cb0a95f39f74da5b15d820391203c6366add668df Jul 15 14:39:05.700136 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:05.700097 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4" event={"ID":"b7e96ebf-e571-442c-ae48-048cb234d8cd","Type":"ContainerStarted","Data":"c8cac0f0e56ca94bfc1fa06cb0a95f39f74da5b15d820391203c6366add668df"} Jul 15 14:39:07.709689 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:07.709657 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4" event={"ID":"b7e96ebf-e571-442c-ae48-048cb234d8cd","Type":"ContainerStarted","Data":"1fbe446acfeec37ac158930def3eb97b738d779aff51f5a2ea2ceabcba9c65cb"} Jul 15 14:39:07.710100 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:07.709719 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4" Jul 15 14:39:08.408593 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.408536 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4" podStartSLOduration=2.040643283 podStartE2EDuration="4.408517841s" totalImagesPullingTime="2.367874558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:39:07.740757801 +0000 UTC m=+507.613692361" watchObservedRunningTime="2026-07-15 14:39:08.408517841 +0000 UTC m=+508.281452401" Jul 15 14:39:08.409690 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.409672 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz"] Jul 15 14:39:08.412965 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.412951 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.417474 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.417451 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-nchb4\"" Jul 15 14:39:08.418663 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.418646 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 14:39:08.429458 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.429431 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 14:39:08.432386 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.432370 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 14:39:08.466973 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.466944 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz"] Jul 15 14:39:08.565586 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.565546 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ff8b3-07b8-4dca-b52a-90421a18781b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.565586 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.565589 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1ff8b3-07b8-4dca-b52a-90421a18781b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.565856 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.565613 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1ff8b3-07b8-4dca-b52a-90421a18781b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.565856 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.565634 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ff8b3-07b8-4dca-b52a-90421a18781b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.565856 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.565650 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1ff8b3-07b8-4dca-b52a-90421a18781b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.565856 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.565715 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1ff8b3-07b8-4dca-b52a-90421a18781b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.565856 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.565751 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1ff8b3-07b8-4dca-b52a-90421a18781b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.565856 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.565774 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhg6p\" (UniqueName: \"kubernetes.io/projected/6f1ff8b3-07b8-4dca-b52a-90421a18781b-kube-api-access-zhg6p\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.566040 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.565880 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1ff8b3-07b8-4dca-b52a-90421a18781b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.667119 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.667025 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1ff8b3-07b8-4dca-b52a-90421a18781b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.667119 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.667073 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1ff8b3-07b8-4dca-b52a-90421a18781b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.667119 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.667108 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ff8b3-07b8-4dca-b52a-90421a18781b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.667394 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.667134 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1ff8b3-07b8-4dca-b52a-90421a18781b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.667394 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.667165 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1ff8b3-07b8-4dca-b52a-90421a18781b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.667394 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.667193 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1ff8b3-07b8-4dca-b52a-90421a18781b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.667394 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.667229 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhg6p\" (UniqueName: \"kubernetes.io/projected/6f1ff8b3-07b8-4dca-b52a-90421a18781b-kube-api-access-zhg6p\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.667394 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.667277 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1ff8b3-07b8-4dca-b52a-90421a18781b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.667394 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.667318 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ff8b3-07b8-4dca-b52a-90421a18781b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.667680 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.667606 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ff8b3-07b8-4dca-b52a-90421a18781b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.667680 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.667622 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1ff8b3-07b8-4dca-b52a-90421a18781b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.667782 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.667707 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ff8b3-07b8-4dca-b52a-90421a18781b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.667782 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.667750 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1ff8b3-07b8-4dca-b52a-90421a18781b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.668111 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.668093 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1ff8b3-07b8-4dca-b52a-90421a18781b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.669443 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.669414 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1ff8b3-07b8-4dca-b52a-90421a18781b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.669885 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.669866 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1ff8b3-07b8-4dca-b52a-90421a18781b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.687678 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.687654 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1ff8b3-07b8-4dca-b52a-90421a18781b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.688159 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.688141 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhg6p\" (UniqueName: \"kubernetes.io/projected/6f1ff8b3-07b8-4dca-b52a-90421a18781b-kube-api-access-zhg6p\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sqsgz\" (UID: \"6f1ff8b3-07b8-4dca-b52a-90421a18781b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.722431 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.722407 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:08.879937 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:08.879861 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz"] Jul 15 14:39:08.882426 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:39:08.882400 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1ff8b3_07b8_4dca_b52a_90421a18781b.slice/crio-b3540e77012efdd011f65d006c58e7b137b2d23a458da7b8eb589754697eaff9 WatchSource:0}: Error finding container b3540e77012efdd011f65d006c58e7b137b2d23a458da7b8eb589754697eaff9: Status 404 returned error can't find the container with id b3540e77012efdd011f65d006c58e7b137b2d23a458da7b8eb589754697eaff9 Jul 15 14:39:09.724743 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:09.724700 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" event={"ID":"6f1ff8b3-07b8-4dca-b52a-90421a18781b","Type":"ContainerStarted","Data":"b3540e77012efdd011f65d006c58e7b137b2d23a458da7b8eb589754697eaff9"} Jul 15 14:39:10.204748 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.204708 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5"] Jul 15 14:39:10.208258 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.208236 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.211789 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.211763 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 14:39:10.211789 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.211763 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 14:39:10.212044 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.211800 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-g9z86\"" Jul 15 14:39:10.212217 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.212200 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 14:39:10.238693 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.238664 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5"] Jul 15 14:39:10.283791 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.283758 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.283979 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.283797 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.283979 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.283882 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.283979 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.283907 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.283979 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.283957 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.284191 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.284005 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.284191 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.284031 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fknc\" (UniqueName: \"kubernetes.io/projected/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-kube-api-access-9fknc\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.385044 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.384998 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.385234 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.385054 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.385234 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.385097 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.385234 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.385133 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.385234 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.385178 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.385234 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.385214 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.385496 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.385242 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fknc\" (UniqueName: \"kubernetes.io/projected/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-kube-api-access-9fknc\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.386156 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.386104 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.387735 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.387678 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.388031 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.388012 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.388124 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.388054 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.388368 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.388346 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.470442 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.470372 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.481752 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.481726 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fknc\" (UniqueName: \"kubernetes.io/projected/e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d-kube-api-access-9fknc\") pod \"istiod-openshift-gateway-94bb8fbfd-p6xt5\" (UID: \"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:10.519982 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:10.519948 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:11.510119 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:11.510076 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:39:11.510444 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:11.510174 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:39:11.510444 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:11.510208 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:39:11.611307 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:11.611276 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5"] Jul 15 14:39:11.613709 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:39:11.613680 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a1ffc9_e8dd_4b3f_857f_4bec32387b9d.slice/crio-3a192512a571d1e6da80335954fbc8942d422f5f2310c3281a84134d2760f8fc WatchSource:0}: Error finding container 3a192512a571d1e6da80335954fbc8942d422f5f2310c3281a84134d2760f8fc: Status 404 returned error can't find the container with id 3a192512a571d1e6da80335954fbc8942d422f5f2310c3281a84134d2760f8fc Jul 15 14:39:11.735553 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:11.735461 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" event={"ID":"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d","Type":"ContainerStarted","Data":"3a192512a571d1e6da80335954fbc8942d422f5f2310c3281a84134d2760f8fc"} Jul 15 14:39:11.737124 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:11.737096 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" event={"ID":"6f1ff8b3-07b8-4dca-b52a-90421a18781b","Type":"ContainerStarted","Data":"95fbf6349cf1dd1357db1919ba9248d4c87a6277c3b73630d01e52a1463f357f"} Jul 15 14:39:11.816313 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:11.816261 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" podStartSLOduration=1.191005428 podStartE2EDuration="3.816243751s" totalImagesPullingTime="2.625238323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:39:11.815511727 +0000 UTC m=+511.688446287" watchObservedRunningTime="2026-07-15 14:39:11.816243751 +0000 UTC m=+511.689178310" Jul 15 14:39:12.722714 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:12.722684 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:12.727329 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:12.727306 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:12.740782 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:12.740756 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:12.741561 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:12.741543 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sqsgz" Jul 15 14:39:14.900158 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:14.900116 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:39:14.900443 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:14.900201 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:39:15.758399 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:15.758362 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" event={"ID":"e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d","Type":"ContainerStarted","Data":"dafc7c6b4c9f99e0f34204185b321e9c6b238650e7f8cef82f1e6ae24449006c"} Jul 15 14:39:15.758565 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:15.758546 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:15.760276 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:15.760244 2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-p6xt5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 14:39:15.760425 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:15.760297 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" podUID="e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 14:39:15.826859 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:15.826788 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" podStartSLOduration=2.543194875 podStartE2EDuration="5.826771291s" totalImagesPullingTime="3.283576416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:39:15.825614035 +0000 UTC m=+515.698548596" watchObservedRunningTime="2026-07-15 14:39:15.826771291 +0000 UTC m=+515.699705851" Jul 15 14:39:16.763360 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:16.763332 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p6xt5" Jul 15 14:39:18.715291 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:39:18.715256 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-cfng4" Jul 15 14:41:42.095902 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.095866 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm"] Jul 15 14:41:42.097882 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.097867 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.100925 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.100906 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-dkxdx\"" Jul 15 14:41:42.129295 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.129267 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm"] Jul 15 14:41:42.182094 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.182060 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41019b40-c6db-403e-a5eb-d43c17c37364-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.182094 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.182094 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41019b40-c6db-403e-a5eb-d43c17c37364-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.182332 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.182115 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41019b40-c6db-403e-a5eb-d43c17c37364-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.182332 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.182138 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41019b40-c6db-403e-a5eb-d43c17c37364-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.182332 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.182243 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41019b40-c6db-403e-a5eb-d43c17c37364-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.182492 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.182346 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41019b40-c6db-403e-a5eb-d43c17c37364-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.182492 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.182419 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h9hx\" (UniqueName: \"kubernetes.io/projected/41019b40-c6db-403e-a5eb-d43c17c37364-kube-api-access-6h9hx\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.182492 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.182464 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41019b40-c6db-403e-a5eb-d43c17c37364-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.182608 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.182532 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41019b40-c6db-403e-a5eb-d43c17c37364-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.283382 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.283345 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h9hx\" (UniqueName: \"kubernetes.io/projected/41019b40-c6db-403e-a5eb-d43c17c37364-kube-api-access-6h9hx\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.283566 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.283390 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41019b40-c6db-403e-a5eb-d43c17c37364-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.283566 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.283412 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41019b40-c6db-403e-a5eb-d43c17c37364-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.283566 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.283428 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41019b40-c6db-403e-a5eb-d43c17c37364-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.283566 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.283448 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41019b40-c6db-403e-a5eb-d43c17c37364-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.283566 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.283466 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41019b40-c6db-403e-a5eb-d43c17c37364-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.283566 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.283489 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41019b40-c6db-403e-a5eb-d43c17c37364-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.283566 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.283509 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41019b40-c6db-403e-a5eb-d43c17c37364-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.283566 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.283555 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41019b40-c6db-403e-a5eb-d43c17c37364-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.284051 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.283917 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41019b40-c6db-403e-a5eb-d43c17c37364-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.284051 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.283933 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41019b40-c6db-403e-a5eb-d43c17c37364-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.284152 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.284063 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41019b40-c6db-403e-a5eb-d43c17c37364-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.284152 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.284108 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41019b40-c6db-403e-a5eb-d43c17c37364-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.284424 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.284407 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41019b40-c6db-403e-a5eb-d43c17c37364-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.286210 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.286174 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41019b40-c6db-403e-a5eb-d43c17c37364-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.286335 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.286219 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41019b40-c6db-403e-a5eb-d43c17c37364-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.295416 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.295382 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h9hx\" (UniqueName: \"kubernetes.io/projected/41019b40-c6db-403e-a5eb-d43c17c37364-kube-api-access-6h9hx\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.295525 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.295394 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41019b40-c6db-403e-a5eb-d43c17c37364-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-klmdm\" (UID: \"41019b40-c6db-403e-a5eb-d43c17c37364\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.408283 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.408249 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:42.549317 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.549295 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm"] Jul 15 14:41:42.551632 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:41:42.551607 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41019b40_c6db_403e_a5eb_d43c17c37364.slice/crio-11042ed777df60120df337cf04af9f73935ffa2d525f27b4eccdf91724240a61 WatchSource:0}: Error finding container 11042ed777df60120df337cf04af9f73935ffa2d525f27b4eccdf91724240a61: Status 404 returned error can't find the container with id 11042ed777df60120df337cf04af9f73935ffa2d525f27b4eccdf91724240a61 Jul 15 14:41:42.553572 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.553541 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:41:42.553648 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.553607 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:41:42.553648 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:42.553635 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:41:43.338949 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:43.338915 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" event={"ID":"41019b40-c6db-403e-a5eb-d43c17c37364","Type":"ContainerStarted","Data":"a695b96b085f39947198dab24616a15816891ea11ee3cceb8b24d4e0c2dd5e8e"} Jul 15 14:41:43.339327 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:43.338997 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" event={"ID":"41019b40-c6db-403e-a5eb-d43c17c37364","Type":"ContainerStarted","Data":"11042ed777df60120df337cf04af9f73935ffa2d525f27b4eccdf91724240a61"} Jul 15 14:41:43.372503 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:43.372451 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" podStartSLOduration=1.372434192 podStartE2EDuration="1.372434192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:41:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:41:43.371604481 +0000 UTC m=+663.244539043" watchObservedRunningTime="2026-07-15 14:41:43.372434192 +0000 UTC m=+663.245368752" Jul 15 14:41:43.409047 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:43.409009 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:43.413665 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:43.413642 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:44.342958 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:44.342927 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:41:44.343820 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:41:44.343793 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:43:06.686680 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:06.686648 2565 generic.go:356] "Generic (PLEG): container finished" podID="41019b40-c6db-403e-a5eb-d43c17c37364" containerID="a695b96b085f39947198dab24616a15816891ea11ee3cceb8b24d4e0c2dd5e8e" exitCode=0 Jul 15 14:43:06.687134 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:06.686687 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" event={"ID":"41019b40-c6db-403e-a5eb-d43c17c37364","Type":"ContainerDied","Data":"a695b96b085f39947198dab24616a15816891ea11ee3cceb8b24d4e0c2dd5e8e"} Jul 15 14:43:06.687134 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:06.687073 2565 scope.go:117] "RemoveContainer" containerID="a695b96b085f39947198dab24616a15816891ea11ee3cceb8b24d4e0c2dd5e8e" Jul 15 14:43:06.688144 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:06.688119 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:43:06.688208 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:06.688185 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:43:06.688242 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:06.688215 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:43:07.692074 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:07.692043 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" event={"ID":"41019b40-c6db-403e-a5eb-d43c17c37364","Type":"ContainerStarted","Data":"574689f9d99ed1986adf934847aad906c9754b0d49acc32a2bcdb7b41827cb64"} Jul 15 14:43:08.408888 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:08.408850 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:43:08.409129 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:08.409107 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-klmdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body= Jul 15 14:43:08.409190 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:08.409170 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" podUID="41019b40-c6db-403e-a5eb-d43c17c37364" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" Jul 15 14:43:09.409606 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:09.409568 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-klmdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body= Jul 15 14:43:09.410034 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:09.409636 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" podUID="41019b40-c6db-403e-a5eb-d43c17c37364" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" Jul 15 14:43:10.409177 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:10.409140 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-klmdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body= Jul 15 14:43:10.409334 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:10.409201 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" podUID="41019b40-c6db-403e-a5eb-d43c17c37364" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" Jul 15 14:43:11.409211 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:11.409179 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-klmdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body= Jul 15 14:43:11.409624 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:11.409238 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" podUID="41019b40-c6db-403e-a5eb-d43c17c37364" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" Jul 15 14:43:12.408936 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:12.408905 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-klmdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body= Jul 15 14:43:12.409104 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:12.408967 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" podUID="41019b40-c6db-403e-a5eb-d43c17c37364" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" Jul 15 14:43:13.412656 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:13.412620 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:43:13.413048 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:13.412884 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:43:13.413604 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:13.413582 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klmdm" Jul 15 14:43:47.898997 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:47.898961 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp"] Jul 15 14:43:47.901353 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:47.901336 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:47.902043 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:47.902015 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/baaed8ba-3cd2-4217-88b7-fb4a59aff923-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7ltjp\" (UID: \"baaed8ba-3cd2-4217-88b7-fb4a59aff923\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:47.902162 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:47.902048 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baaed8ba-3cd2-4217-88b7-fb4a59aff923-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7ltjp\" (UID: \"baaed8ba-3cd2-4217-88b7-fb4a59aff923\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:47.902162 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:47.902119 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/baaed8ba-3cd2-4217-88b7-fb4a59aff923-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7ltjp\" (UID: \"baaed8ba-3cd2-4217-88b7-fb4a59aff923\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:47.902278 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:47.902184 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/baaed8ba-3cd2-4217-88b7-fb4a59aff923-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7ltjp\" (UID: \"baaed8ba-3cd2-4217-88b7-fb4a59aff923\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:47.902278 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:47.902215 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x52vg\" (UniqueName: \"kubernetes.io/projected/baaed8ba-3cd2-4217-88b7-fb4a59aff923-kube-api-access-x52vg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7ltjp\" (UID: \"baaed8ba-3cd2-4217-88b7-fb4a59aff923\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:47.902372 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:47.902282 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/baaed8ba-3cd2-4217-88b7-fb4a59aff923-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7ltjp\" (UID: \"baaed8ba-3cd2-4217-88b7-fb4a59aff923\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:47.903773 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:47.903758 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jhjp2\"" Jul 15 14:43:47.904932 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:47.904912 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 14:43:47.905024 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:47.904957 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 14:43:47.905024 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:47.904965 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 15 14:43:47.915188 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:47.915167 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp"] Jul 15 14:43:48.002722 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:48.002689 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/baaed8ba-3cd2-4217-88b7-fb4a59aff923-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7ltjp\" (UID: \"baaed8ba-3cd2-4217-88b7-fb4a59aff923\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:48.002916 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:48.002731 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/baaed8ba-3cd2-4217-88b7-fb4a59aff923-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7ltjp\" (UID: \"baaed8ba-3cd2-4217-88b7-fb4a59aff923\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:48.002916 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:48.002751 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x52vg\" (UniqueName: \"kubernetes.io/projected/baaed8ba-3cd2-4217-88b7-fb4a59aff923-kube-api-access-x52vg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7ltjp\" (UID: \"baaed8ba-3cd2-4217-88b7-fb4a59aff923\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:48.003012 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:48.002942 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/baaed8ba-3cd2-4217-88b7-fb4a59aff923-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7ltjp\" (UID: \"baaed8ba-3cd2-4217-88b7-fb4a59aff923\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:48.003086 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:48.003070 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/baaed8ba-3cd2-4217-88b7-fb4a59aff923-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7ltjp\" (UID: \"baaed8ba-3cd2-4217-88b7-fb4a59aff923\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:48.003136 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:48.003098 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baaed8ba-3cd2-4217-88b7-fb4a59aff923-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7ltjp\" (UID: \"baaed8ba-3cd2-4217-88b7-fb4a59aff923\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:48.003187 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:48.003142 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/baaed8ba-3cd2-4217-88b7-fb4a59aff923-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7ltjp\" (UID: \"baaed8ba-3cd2-4217-88b7-fb4a59aff923\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:48.003187 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:48.003175 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/baaed8ba-3cd2-4217-88b7-fb4a59aff923-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7ltjp\" (UID: \"baaed8ba-3cd2-4217-88b7-fb4a59aff923\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:48.003361 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:48.003346 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baaed8ba-3cd2-4217-88b7-fb4a59aff923-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7ltjp\" (UID: \"baaed8ba-3cd2-4217-88b7-fb4a59aff923\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:48.005204 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:48.005184 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/baaed8ba-3cd2-4217-88b7-fb4a59aff923-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7ltjp\" (UID: \"baaed8ba-3cd2-4217-88b7-fb4a59aff923\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:48.005491 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:48.005474 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/baaed8ba-3cd2-4217-88b7-fb4a59aff923-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7ltjp\" (UID: \"baaed8ba-3cd2-4217-88b7-fb4a59aff923\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:48.012012 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:48.011971 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x52vg\" (UniqueName: \"kubernetes.io/projected/baaed8ba-3cd2-4217-88b7-fb4a59aff923-kube-api-access-x52vg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7ltjp\" (UID: \"baaed8ba-3cd2-4217-88b7-fb4a59aff923\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:48.211078 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:48.210986 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:48.367627 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:48.367598 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp"] Jul 15 14:43:48.370647 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:43:48.370617 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaaed8ba_3cd2_4217_88b7_fb4a59aff923.slice/crio-5969ac85307a1c4b305d77527161d4c42ba353ec79f284849e7d542a30d5be4d WatchSource:0}: Error finding container 5969ac85307a1c4b305d77527161d4c42ba353ec79f284849e7d542a30d5be4d: Status 404 returned error can't find the container with id 5969ac85307a1c4b305d77527161d4c42ba353ec79f284849e7d542a30d5be4d Jul 15 14:43:48.371992 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:48.371974 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 14:43:48.854441 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:48.854407 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" event={"ID":"baaed8ba-3cd2-4217-88b7-fb4a59aff923","Type":"ContainerStarted","Data":"5969ac85307a1c4b305d77527161d4c42ba353ec79f284849e7d542a30d5be4d"} Jul 15 14:43:50.867371 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:50.867331 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" event={"ID":"baaed8ba-3cd2-4217-88b7-fb4a59aff923","Type":"ContainerStarted","Data":"d85c7234d1105b6a319f243b6e01522ded73dd7f76216445884652ad82525438"} Jul 15 14:43:50.891841 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:50.891770 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" podStartSLOduration=2.221529284 podStartE2EDuration="3.891754145s" totalImagesPullingTime="1.670224861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:43:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:43:50.890578891 +0000 UTC m=+790.763513450" watchObservedRunningTime="2026-07-15 14:43:50.891754145 +0000 UTC m=+790.764688705" Jul 15 14:43:58.212006 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:58.211968 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:58.212398 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:58.212033 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:58.224569 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:58.224543 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:43:58.912171 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:43:58.912141 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7ltjp" Jul 15 14:44:16.906228 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:16.906136 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p"] Jul 15 14:44:16.910831 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:16.909745 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:16.913931 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:16.913908 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 15 14:44:16.932268 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:16.932238 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p"] Jul 15 14:44:17.065360 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.065328 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d302fc9b-1a8d-407a-b6ef-0695cfc32003-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p\" (UID: \"d302fc9b-1a8d-407a-b6ef-0695cfc32003\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:17.065360 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.065360 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d302fc9b-1a8d-407a-b6ef-0695cfc32003-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p\" (UID: \"d302fc9b-1a8d-407a-b6ef-0695cfc32003\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:17.065565 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.065467 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d302fc9b-1a8d-407a-b6ef-0695cfc32003-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p\" (UID: \"d302fc9b-1a8d-407a-b6ef-0695cfc32003\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:17.065565 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.065505 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsrtf\" (UniqueName: \"kubernetes.io/projected/d302fc9b-1a8d-407a-b6ef-0695cfc32003-kube-api-access-nsrtf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p\" (UID: \"d302fc9b-1a8d-407a-b6ef-0695cfc32003\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:17.065565 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.065528 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d302fc9b-1a8d-407a-b6ef-0695cfc32003-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p\" (UID: \"d302fc9b-1a8d-407a-b6ef-0695cfc32003\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:17.065565 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.065563 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d302fc9b-1a8d-407a-b6ef-0695cfc32003-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p\" (UID: \"d302fc9b-1a8d-407a-b6ef-0695cfc32003\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:17.166373 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.166288 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d302fc9b-1a8d-407a-b6ef-0695cfc32003-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p\" (UID: \"d302fc9b-1a8d-407a-b6ef-0695cfc32003\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:17.166373 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.166332 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d302fc9b-1a8d-407a-b6ef-0695cfc32003-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p\" (UID: \"d302fc9b-1a8d-407a-b6ef-0695cfc32003\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:17.166373 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.166352 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d302fc9b-1a8d-407a-b6ef-0695cfc32003-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p\" (UID: \"d302fc9b-1a8d-407a-b6ef-0695cfc32003\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:17.166618 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.166445 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d302fc9b-1a8d-407a-b6ef-0695cfc32003-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p\" (UID: \"d302fc9b-1a8d-407a-b6ef-0695cfc32003\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:17.166618 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.166482 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsrtf\" (UniqueName: \"kubernetes.io/projected/d302fc9b-1a8d-407a-b6ef-0695cfc32003-kube-api-access-nsrtf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p\" (UID: \"d302fc9b-1a8d-407a-b6ef-0695cfc32003\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:17.166618 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.166512 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d302fc9b-1a8d-407a-b6ef-0695cfc32003-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p\" (UID: \"d302fc9b-1a8d-407a-b6ef-0695cfc32003\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:17.166765 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.166680 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d302fc9b-1a8d-407a-b6ef-0695cfc32003-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p\" (UID: \"d302fc9b-1a8d-407a-b6ef-0695cfc32003\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:17.166847 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.166799 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d302fc9b-1a8d-407a-b6ef-0695cfc32003-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p\" (UID: \"d302fc9b-1a8d-407a-b6ef-0695cfc32003\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:17.166945 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.166926 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d302fc9b-1a8d-407a-b6ef-0695cfc32003-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p\" (UID: \"d302fc9b-1a8d-407a-b6ef-0695cfc32003\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:17.168549 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.168527 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d302fc9b-1a8d-407a-b6ef-0695cfc32003-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p\" (UID: \"d302fc9b-1a8d-407a-b6ef-0695cfc32003\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:17.168798 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.168780 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d302fc9b-1a8d-407a-b6ef-0695cfc32003-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p\" (UID: \"d302fc9b-1a8d-407a-b6ef-0695cfc32003\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:17.176513 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.176488 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsrtf\" (UniqueName: \"kubernetes.io/projected/d302fc9b-1a8d-407a-b6ef-0695cfc32003-kube-api-access-nsrtf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p\" (UID: \"d302fc9b-1a8d-407a-b6ef-0695cfc32003\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:17.221012 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.220974 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:17.356411 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.356382 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p"] Jul 15 14:44:17.357897 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:44:17.357867 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd302fc9b_1a8d_407a_b6ef_0695cfc32003.slice/crio-886e6e6b1c317f90405c1e2c32c3975d50e4d9667896f19b701a76e042a7cc40 WatchSource:0}: Error finding container 886e6e6b1c317f90405c1e2c32c3975d50e4d9667896f19b701a76e042a7cc40: Status 404 returned error can't find the container with id 886e6e6b1c317f90405c1e2c32c3975d50e4d9667896f19b701a76e042a7cc40 Jul 15 14:44:17.977879 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.977845 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" event={"ID":"d302fc9b-1a8d-407a-b6ef-0695cfc32003","Type":"ContainerStarted","Data":"f4d6cfbdbd5cec6a8776ce4662ea739fb06100f15da30019af29d652508026a6"} Jul 15 14:44:17.978286 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.977905 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" event={"ID":"d302fc9b-1a8d-407a-b6ef-0695cfc32003","Type":"ContainerStarted","Data":"886e6e6b1c317f90405c1e2c32c3975d50e4d9667896f19b701a76e042a7cc40"} Jul 15 14:44:17.998569 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:17.998522 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" podStartSLOduration=1.804007589 podStartE2EDuration="1.998506871s" totalImagesPullingTime="194.499282ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:44:17.998274666 +0000 UTC m=+817.871209227" watchObservedRunningTime="2026-07-15 14:44:17.998506871 +0000 UTC m=+817.871441431" Jul 15 14:44:27.221570 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:27.221500 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:27.222071 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:27.221636 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:27.234353 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:27.234322 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:44:28.029247 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:44:28.029215 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p" Jul 15 14:58:58.236617 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.236536 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2"] Jul 15 14:58:58.239870 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.239851 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.243210 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.243191 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2eb856f0-openshift-default-dockercfg-45mrg\"" Jul 15 14:58:58.281459 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.281433 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2"] Jul 15 14:58:58.363657 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.363626 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-envoy\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.363860 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.363670 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-workload-certs\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.363860 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.363693 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-data\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.363860 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.363751 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-workload-socket\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.363860 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.363837 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwcjv\" (UniqueName: \"kubernetes.io/projected/be60aa25-cb86-4d39-88fa-6bcdba88928d-kube-api-access-rwcjv\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.364003 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.363906 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-podinfo\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.364003 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.363939 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-credential-socket\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.364003 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.363965 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-token\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.364093 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.364001 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be60aa25-cb86-4d39-88fa-6bcdba88928d-istiod-ca-cert\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.465039 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.465003 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwcjv\" (UniqueName: \"kubernetes.io/projected/be60aa25-cb86-4d39-88fa-6bcdba88928d-kube-api-access-rwcjv\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.465229 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.465058 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-podinfo\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.465229 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.465091 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-credential-socket\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.465229 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.465121 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-token\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.465229 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.465162 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be60aa25-cb86-4d39-88fa-6bcdba88928d-istiod-ca-cert\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.465229 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.465212 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-envoy\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.465493 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.465256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-workload-certs\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.465493 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.465277 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-data\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.465493 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.465305 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-workload-socket\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.465651 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.465597 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-credential-socket\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.465702 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.465662 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-workload-socket\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.465760 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.465725 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-data\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.465851 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.465781 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-workload-certs\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.466038 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.466020 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be60aa25-cb86-4d39-88fa-6bcdba88928d-istiod-ca-cert\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.467415 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.467396 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-envoy\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.467547 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.467530 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-podinfo\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.473946 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.473919 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-token\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.474141 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.474122 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwcjv\" (UniqueName: \"kubernetes.io/projected/be60aa25-cb86-4d39-88fa-6bcdba88928d-kube-api-access-rwcjv\") pod \"e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.550439 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.550330 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:58:58.684062 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.684037 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2"] Jul 15 14:58:58.686595 ip-10-0-136-155 kubenswrapper[2565]: W0715 14:58:58.686571 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe60aa25_cb86_4d39_88fa_6bcdba88928d.slice/crio-cf21919c563e18e9a624943cf44dcff554f924be78825535d5ce5c50d47675af WatchSource:0}: Error finding container cf21919c563e18e9a624943cf44dcff554f924be78825535d5ce5c50d47675af: Status 404 returned error can't find the container with id cf21919c563e18e9a624943cf44dcff554f924be78825535d5ce5c50d47675af Jul 15 14:58:58.688610 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.688571 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:58:58.688673 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.688658 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:58:58.688709 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:58.688700 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:58:59.641187 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:59.641154 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" event={"ID":"be60aa25-cb86-4d39-88fa-6bcdba88928d","Type":"ContainerStarted","Data":"a36e99c15f89bc6256a41fa936dd3b1c29d3e3c8c659252baea48324dfd37216"} Jul 15 14:58:59.641603 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:59.641207 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" event={"ID":"be60aa25-cb86-4d39-88fa-6bcdba88928d","Type":"ContainerStarted","Data":"cf21919c563e18e9a624943cf44dcff554f924be78825535d5ce5c50d47675af"} Jul 15 14:58:59.674593 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:58:59.674542 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" podStartSLOduration=1.6745251589999999 podStartE2EDuration="1.674525159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:58:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:58:59.672642658 +0000 UTC m=+1699.545577219" watchObservedRunningTime="2026-07-15 14:58:59.674525159 +0000 UTC m=+1699.547459718" Jul 15 14:59:00.550702 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:00.550661 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:59:00.555678 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:00.555653 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:59:00.645631 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:00.645598 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:59:00.646754 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:00.646733 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:59:16.646700 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:16.646658 2565 patch_prober.go:28] interesting pod/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 14:59:16.647159 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:16.646726 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" podUID="be60aa25-cb86-4d39-88fa-6bcdba88928d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 14:59:18.720362 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:18.720330 2565 generic.go:356] "Generic (PLEG): container finished" podID="be60aa25-cb86-4d39-88fa-6bcdba88928d" containerID="a36e99c15f89bc6256a41fa936dd3b1c29d3e3c8c659252baea48324dfd37216" exitCode=0 Jul 15 14:59:18.720871 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:18.720402 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" event={"ID":"be60aa25-cb86-4d39-88fa-6bcdba88928d","Type":"ContainerDied","Data":"a36e99c15f89bc6256a41fa936dd3b1c29d3e3c8c659252baea48324dfd37216"} Jul 15 14:59:18.720871 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:18.720823 2565 scope.go:117] "RemoveContainer" containerID="a36e99c15f89bc6256a41fa936dd3b1c29d3e3c8c659252baea48324dfd37216" Jul 15 14:59:18.721834 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:18.721789 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:59:18.721936 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:18.721870 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:59:18.721936 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:18.721900 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:59:19.726974 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:19.726944 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" event={"ID":"be60aa25-cb86-4d39-88fa-6bcdba88928d","Type":"ContainerStarted","Data":"1897796a26652b9369596c663e23b5bb66d71ec0adeba9dc6842811c07e147c5"} Jul 15 14:59:20.551393 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:20.551292 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:59:20.551639 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:20.551607 2565 patch_prober.go:28] interesting pod/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jul 15 14:59:20.551904 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:20.551876 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" podUID="be60aa25-cb86-4d39-88fa-6bcdba88928d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jul 15 14:59:21.551770 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:21.551728 2565 patch_prober.go:28] interesting pod/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jul 15 14:59:21.552397 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:21.552364 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" podUID="be60aa25-cb86-4d39-88fa-6bcdba88928d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jul 15 14:59:22.550941 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:22.550892 2565 patch_prober.go:28] interesting pod/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jul 15 14:59:22.551157 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:22.550985 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" podUID="be60aa25-cb86-4d39-88fa-6bcdba88928d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jul 15 14:59:23.551406 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:23.550920 2565 patch_prober.go:28] interesting pod/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jul 15 14:59:23.551406 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:23.550999 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" podUID="be60aa25-cb86-4d39-88fa-6bcdba88928d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jul 15 14:59:24.555192 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:24.555164 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:59:24.555567 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:24.555423 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 14:59:24.556083 ip-10-0-136-155 kubenswrapper[2565]: I0715 14:59:24.556067 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 15:00:19.869083 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:19.869049 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2"] Jul 15 15:00:19.869571 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:19.869271 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" podUID="be60aa25-cb86-4d39-88fa-6bcdba88928d" containerName="istio-proxy" containerID="cri-o://1897796a26652b9369596c663e23b5bb66d71ec0adeba9dc6842811c07e147c5" gracePeriod=30 Jul 15 15:00:20.416886 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.416853 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc"] Jul 15 15:00:20.420530 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.420510 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.423344 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.423320 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-bf27e0e8-gw-openshift-default-dockercfg-844h4\"" Jul 15 15:00:20.442612 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.442586 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc"] Jul 15 15:00:20.513065 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.513030 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-workload-certs\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.513238 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.513078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-podinfo\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.513238 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.513096 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dff65bf2-14da-4357-9fcb-695bc08505f2-istiod-ca-cert\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.513238 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.513170 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-token\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.513238 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.513201 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-credential-socket\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.513238 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.513232 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpbk6\" (UniqueName: \"kubernetes.io/projected/dff65bf2-14da-4357-9fcb-695bc08505f2-kube-api-access-tpbk6\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.513423 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.513262 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-workload-socket\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.513423 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.513281 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-data\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.513423 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.513301 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-envoy\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.614655 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.614612 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-workload-certs\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.614655 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.614664 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-podinfo\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.615027 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.614682 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dff65bf2-14da-4357-9fcb-695bc08505f2-istiod-ca-cert\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.615027 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.614703 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-token\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.615027 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.614890 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-credential-socket\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.615027 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.614943 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpbk6\" (UniqueName: \"kubernetes.io/projected/dff65bf2-14da-4357-9fcb-695bc08505f2-kube-api-access-tpbk6\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.615027 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.614992 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-workload-socket\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.615027 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.615025 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-data\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.615345 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.615061 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-envoy\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.615345 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.615270 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-workload-certs\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.615345 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.615305 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-credential-socket\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.615502 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.615457 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-workload-socket\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.615561 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.615503 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-data\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.615561 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.615548 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dff65bf2-14da-4357-9fcb-695bc08505f2-istiod-ca-cert\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.617215 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.617193 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-envoy\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.617341 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.617324 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-podinfo\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.624429 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.624398 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-token\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.624593 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.624565 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpbk6\" (UniqueName: \"kubernetes.io/projected/dff65bf2-14da-4357-9fcb-695bc08505f2-kube-api-access-tpbk6\") pod \"e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.731207 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.731102 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:20.873781 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.873755 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc"] Jul 15 15:00:20.876062 ip-10-0-136-155 kubenswrapper[2565]: W0715 15:00:20.876031 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddff65bf2_14da_4357_9fcb_695bc08505f2.slice/crio-c906185be8ddc5c5484c7c0dfca144ef7c75821382f1c2d4f2e3f8729388fd8d WatchSource:0}: Error finding container c906185be8ddc5c5484c7c0dfca144ef7c75821382f1c2d4f2e3f8729388fd8d: Status 404 returned error can't find the container with id c906185be8ddc5c5484c7c0dfca144ef7c75821382f1c2d4f2e3f8729388fd8d Jul 15 15:00:20.878254 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.878223 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:00:20.878318 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.878290 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:00:20.878360 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.878317 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:00:20.991253 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.991161 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" event={"ID":"dff65bf2-14da-4357-9fcb-695bc08505f2","Type":"ContainerStarted","Data":"9d4a9695b3e922f4e687fcc8fc9d025f4bfdaf83e03c56d82ce60214691251dd"} Jul 15 15:00:20.991253 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:20.991222 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" event={"ID":"dff65bf2-14da-4357-9fcb-695bc08505f2","Type":"ContainerStarted","Data":"c906185be8ddc5c5484c7c0dfca144ef7c75821382f1c2d4f2e3f8729388fd8d"} Jul 15 15:00:21.016288 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:21.016224 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" podStartSLOduration=1.016199723 podStartE2EDuration="1.016199723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:00:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:00:21.014277251 +0000 UTC m=+1780.887211850" watchObservedRunningTime="2026-07-15 15:00:21.016199723 +0000 UTC m=+1780.889134285" Jul 15 15:00:21.731722 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:21.731676 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:21.737027 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:21.736998 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:21.995748 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:21.995659 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:21.996683 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:21.996666 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:24.557655 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:24.557613 2565 patch_prober.go:28] interesting pod/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 15:00:24.558065 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:24.557696 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" podUID="be60aa25-cb86-4d39-88fa-6bcdba88928d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 15:00:25.011004 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.010967 2565 generic.go:356] "Generic (PLEG): container finished" podID="be60aa25-cb86-4d39-88fa-6bcdba88928d" containerID="1897796a26652b9369596c663e23b5bb66d71ec0adeba9dc6842811c07e147c5" exitCode=0 Jul 15 15:00:25.011167 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.011011 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" event={"ID":"be60aa25-cb86-4d39-88fa-6bcdba88928d","Type":"ContainerDied","Data":"1897796a26652b9369596c663e23b5bb66d71ec0adeba9dc6842811c07e147c5"} Jul 15 15:00:25.011167 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.011063 2565 scope.go:117] "RemoveContainer" containerID="a36e99c15f89bc6256a41fa936dd3b1c29d3e3c8c659252baea48324dfd37216" Jul 15 15:00:25.115583 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.115557 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 15:00:25.262240 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.262196 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-credential-socket\") pod \"be60aa25-cb86-4d39-88fa-6bcdba88928d\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " Jul 15 15:00:25.262432 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.262287 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-envoy\") pod \"be60aa25-cb86-4d39-88fa-6bcdba88928d\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " Jul 15 15:00:25.262432 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.262311 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be60aa25-cb86-4d39-88fa-6bcdba88928d-istiod-ca-cert\") pod \"be60aa25-cb86-4d39-88fa-6bcdba88928d\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " Jul 15 15:00:25.262432 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.262400 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwcjv\" (UniqueName: \"kubernetes.io/projected/be60aa25-cb86-4d39-88fa-6bcdba88928d-kube-api-access-rwcjv\") pod \"be60aa25-cb86-4d39-88fa-6bcdba88928d\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " Jul 15 15:00:25.262432 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.262429 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-workload-certs\") pod \"be60aa25-cb86-4d39-88fa-6bcdba88928d\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " Jul 15 15:00:25.262711 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.262472 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "be60aa25-cb86-4d39-88fa-6bcdba88928d" (UID: "be60aa25-cb86-4d39-88fa-6bcdba88928d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:00:25.262711 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.262571 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-workload-socket\") pod \"be60aa25-cb86-4d39-88fa-6bcdba88928d\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " Jul 15 15:00:25.262711 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.262646 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-podinfo\") pod \"be60aa25-cb86-4d39-88fa-6bcdba88928d\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " Jul 15 15:00:25.262711 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.262662 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "be60aa25-cb86-4d39-88fa-6bcdba88928d" (UID: "be60aa25-cb86-4d39-88fa-6bcdba88928d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:00:25.262711 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.262675 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-data\") pod \"be60aa25-cb86-4d39-88fa-6bcdba88928d\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " Jul 15 15:00:25.262711 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.262699 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-token\") pod \"be60aa25-cb86-4d39-88fa-6bcdba88928d\" (UID: \"be60aa25-cb86-4d39-88fa-6bcdba88928d\") " Jul 15 15:00:25.263106 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.262847 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "be60aa25-cb86-4d39-88fa-6bcdba88928d" (UID: "be60aa25-cb86-4d39-88fa-6bcdba88928d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:00:25.263106 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.262756 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be60aa25-cb86-4d39-88fa-6bcdba88928d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "be60aa25-cb86-4d39-88fa-6bcdba88928d" (UID: "be60aa25-cb86-4d39-88fa-6bcdba88928d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:00:25.263226 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.263106 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-workload-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:00:25.263226 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.263128 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-workload-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:00:25.263226 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.263142 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-credential-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:00:25.263226 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.263156 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be60aa25-cb86-4d39-88fa-6bcdba88928d-istiod-ca-cert\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:00:25.263534 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.263508 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-data" (OuterVolumeSpecName: "istio-data") pod "be60aa25-cb86-4d39-88fa-6bcdba88928d" (UID: "be60aa25-cb86-4d39-88fa-6bcdba88928d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:00:25.264739 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.264721 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "be60aa25-cb86-4d39-88fa-6bcdba88928d" (UID: "be60aa25-cb86-4d39-88fa-6bcdba88928d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:00:25.264816 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.264730 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "be60aa25-cb86-4d39-88fa-6bcdba88928d" (UID: "be60aa25-cb86-4d39-88fa-6bcdba88928d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 15:00:25.264945 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.264926 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be60aa25-cb86-4d39-88fa-6bcdba88928d-kube-api-access-rwcjv" (OuterVolumeSpecName: "kube-api-access-rwcjv") pod "be60aa25-cb86-4d39-88fa-6bcdba88928d" (UID: "be60aa25-cb86-4d39-88fa-6bcdba88928d"). InnerVolumeSpecName "kube-api-access-rwcjv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:00:25.265045 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.265027 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-token" (OuterVolumeSpecName: "istio-token") pod "be60aa25-cb86-4d39-88fa-6bcdba88928d" (UID: "be60aa25-cb86-4d39-88fa-6bcdba88928d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:00:25.364348 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.364309 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-envoy\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:00:25.364348 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.364341 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwcjv\" (UniqueName: \"kubernetes.io/projected/be60aa25-cb86-4d39-88fa-6bcdba88928d-kube-api-access-rwcjv\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:00:25.364348 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.364351 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-podinfo\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:00:25.364348 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.364362 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-data\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:00:25.364607 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:25.364371 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be60aa25-cb86-4d39-88fa-6bcdba88928d-istio-token\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:00:26.016350 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:26.016323 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" Jul 15 15:00:26.016350 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:26.016331 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2" event={"ID":"be60aa25-cb86-4d39-88fa-6bcdba88928d","Type":"ContainerDied","Data":"cf21919c563e18e9a624943cf44dcff554f924be78825535d5ce5c50d47675af"} Jul 15 15:00:26.016828 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:26.016381 2565 scope.go:117] "RemoveContainer" containerID="1897796a26652b9369596c663e23b5bb66d71ec0adeba9dc6842811c07e147c5" Jul 15 15:00:26.039822 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:26.039786 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2"] Jul 15 15:00:26.043881 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:26.043857 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2eb856f0-openshift-default-7d6dcc79c9-ng4j2"] Jul 15 15:00:26.677187 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:26.677155 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be60aa25-cb86-4d39-88fa-6bcdba88928d" path="/var/lib/kubelet/pods/be60aa25-cb86-4d39-88fa-6bcdba88928d/volumes" Jul 15 15:00:41.089315 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:41.089226 2565 generic.go:356] "Generic (PLEG): container finished" podID="dff65bf2-14da-4357-9fcb-695bc08505f2" containerID="9d4a9695b3e922f4e687fcc8fc9d025f4bfdaf83e03c56d82ce60214691251dd" exitCode=0 Jul 15 15:00:41.089315 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:41.089297 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" event={"ID":"dff65bf2-14da-4357-9fcb-695bc08505f2","Type":"ContainerDied","Data":"9d4a9695b3e922f4e687fcc8fc9d025f4bfdaf83e03c56d82ce60214691251dd"} Jul 15 15:00:41.089755 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:41.089688 2565 scope.go:117] "RemoveContainer" containerID="9d4a9695b3e922f4e687fcc8fc9d025f4bfdaf83e03c56d82ce60214691251dd" Jul 15 15:00:41.090713 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:41.090688 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:00:41.090796 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:41.090751 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:00:41.090796 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:41.090784 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:00:42.095799 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:42.095764 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" event={"ID":"dff65bf2-14da-4357-9fcb-695bc08505f2","Type":"ContainerStarted","Data":"6bd7568be231cadeb7254c4652d4cc65489bfd825d24a1e1c399d2ea39ab0df0"} Jul 15 15:00:42.731588 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:42.731552 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:42.731772 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:42.731747 2565 patch_prober.go:28] interesting pod/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body= Jul 15 15:00:42.731842 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:42.731794 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" podUID="dff65bf2-14da-4357-9fcb-695bc08505f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" Jul 15 15:00:43.731791 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:43.731753 2565 patch_prober.go:28] interesting pod/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body= Jul 15 15:00:43.732227 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:43.731851 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" podUID="dff65bf2-14da-4357-9fcb-695bc08505f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" Jul 15 15:00:44.732291 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:44.732257 2565 patch_prober.go:28] interesting pod/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body= Jul 15 15:00:44.732678 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:44.732309 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" podUID="dff65bf2-14da-4357-9fcb-695bc08505f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" Jul 15 15:00:45.731858 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:45.731798 2565 patch_prober.go:28] interesting pod/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body= Jul 15 15:00:45.732037 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:45.731888 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" podUID="dff65bf2-14da-4357-9fcb-695bc08505f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" Jul 15 15:00:46.736114 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:46.736083 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:46.736528 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:46.736391 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:00:46.737012 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:00:46.736994 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:01:26.307676 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:26.307641 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc"] Jul 15 15:01:26.308214 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:26.307906 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" podUID="dff65bf2-14da-4357-9fcb-695bc08505f2" containerName="istio-proxy" containerID="cri-o://6bd7568be231cadeb7254c4652d4cc65489bfd825d24a1e1c399d2ea39ab0df0" gracePeriod=30 Jul 15 15:01:31.561052 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.561026 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:01:31.578094 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.578011 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-envoy\") pod \"dff65bf2-14da-4357-9fcb-695bc08505f2\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " Jul 15 15:01:31.578094 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.578059 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-token\") pod \"dff65bf2-14da-4357-9fcb-695bc08505f2\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " Jul 15 15:01:31.578094 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.578082 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpbk6\" (UniqueName: \"kubernetes.io/projected/dff65bf2-14da-4357-9fcb-695bc08505f2-kube-api-access-tpbk6\") pod \"dff65bf2-14da-4357-9fcb-695bc08505f2\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " Jul 15 15:01:31.578350 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.578105 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-data\") pod \"dff65bf2-14da-4357-9fcb-695bc08505f2\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " Jul 15 15:01:31.578350 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.578129 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dff65bf2-14da-4357-9fcb-695bc08505f2-istiod-ca-cert\") pod \"dff65bf2-14da-4357-9fcb-695bc08505f2\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " Jul 15 15:01:31.578350 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.578149 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-workload-socket\") pod \"dff65bf2-14da-4357-9fcb-695bc08505f2\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " Jul 15 15:01:31.578350 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.578210 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-podinfo\") pod \"dff65bf2-14da-4357-9fcb-695bc08505f2\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " Jul 15 15:01:31.578350 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.578231 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-credential-socket\") pod \"dff65bf2-14da-4357-9fcb-695bc08505f2\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " Jul 15 15:01:31.578350 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.578277 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-workload-certs\") pod \"dff65bf2-14da-4357-9fcb-695bc08505f2\" (UID: \"dff65bf2-14da-4357-9fcb-695bc08505f2\") " Jul 15 15:01:31.578716 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.578685 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dff65bf2-14da-4357-9fcb-695bc08505f2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dff65bf2-14da-4357-9fcb-695bc08505f2" (UID: "dff65bf2-14da-4357-9fcb-695bc08505f2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:01:31.578848 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.578827 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dff65bf2-14da-4357-9fcb-695bc08505f2" (UID: "dff65bf2-14da-4357-9fcb-695bc08505f2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:01:31.578980 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.578958 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dff65bf2-14da-4357-9fcb-695bc08505f2" (UID: "dff65bf2-14da-4357-9fcb-695bc08505f2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:01:31.579231 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.579208 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dff65bf2-14da-4357-9fcb-695bc08505f2" (UID: "dff65bf2-14da-4357-9fcb-695bc08505f2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:01:31.579326 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.579225 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-data" (OuterVolumeSpecName: "istio-data") pod "dff65bf2-14da-4357-9fcb-695bc08505f2" (UID: "dff65bf2-14da-4357-9fcb-695bc08505f2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:01:31.580364 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.580341 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dff65bf2-14da-4357-9fcb-695bc08505f2-kube-api-access-tpbk6" (OuterVolumeSpecName: "kube-api-access-tpbk6") pod "dff65bf2-14da-4357-9fcb-695bc08505f2" (UID: "dff65bf2-14da-4357-9fcb-695bc08505f2"). InnerVolumeSpecName "kube-api-access-tpbk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:01:31.580467 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.580433 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-token" (OuterVolumeSpecName: "istio-token") pod "dff65bf2-14da-4357-9fcb-695bc08505f2" (UID: "dff65bf2-14da-4357-9fcb-695bc08505f2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:01:31.580580 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.580558 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dff65bf2-14da-4357-9fcb-695bc08505f2" (UID: "dff65bf2-14da-4357-9fcb-695bc08505f2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:01:31.580739 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.580712 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dff65bf2-14da-4357-9fcb-695bc08505f2" (UID: "dff65bf2-14da-4357-9fcb-695bc08505f2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 15:01:31.679487 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.679439 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-envoy\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:01:31.679487 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.679479 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-token\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:01:31.679487 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.679494 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpbk6\" (UniqueName: \"kubernetes.io/projected/dff65bf2-14da-4357-9fcb-695bc08505f2-kube-api-access-tpbk6\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:01:31.679712 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.679508 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-data\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:01:31.679712 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.679519 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dff65bf2-14da-4357-9fcb-695bc08505f2-istiod-ca-cert\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:01:31.679712 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.679530 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-workload-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:01:31.679712 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.679540 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dff65bf2-14da-4357-9fcb-695bc08505f2-istio-podinfo\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:01:31.679712 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.679551 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-credential-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:01:31.679712 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:31.679563 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dff65bf2-14da-4357-9fcb-695bc08505f2-workload-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:01:32.321205 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.321168 2565 generic.go:356] "Generic (PLEG): container finished" podID="dff65bf2-14da-4357-9fcb-695bc08505f2" containerID="6bd7568be231cadeb7254c4652d4cc65489bfd825d24a1e1c399d2ea39ab0df0" exitCode=0 Jul 15 15:01:32.321415 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.321231 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" Jul 15 15:01:32.321415 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.321235 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" event={"ID":"dff65bf2-14da-4357-9fcb-695bc08505f2","Type":"ContainerDied","Data":"6bd7568be231cadeb7254c4652d4cc65489bfd825d24a1e1c399d2ea39ab0df0"} Jul 15 15:01:32.321415 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.321290 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc" event={"ID":"dff65bf2-14da-4357-9fcb-695bc08505f2","Type":"ContainerDied","Data":"c906185be8ddc5c5484c7c0dfca144ef7c75821382f1c2d4f2e3f8729388fd8d"} Jul 15 15:01:32.321415 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.321320 2565 scope.go:117] "RemoveContainer" containerID="6bd7568be231cadeb7254c4652d4cc65489bfd825d24a1e1c399d2ea39ab0df0" Jul 15 15:01:32.330233 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.330215 2565 scope.go:117] "RemoveContainer" containerID="9d4a9695b3e922f4e687fcc8fc9d025f4bfdaf83e03c56d82ce60214691251dd" Jul 15 15:01:32.337969 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.337950 2565 scope.go:117] "RemoveContainer" containerID="6bd7568be231cadeb7254c4652d4cc65489bfd825d24a1e1c399d2ea39ab0df0" Jul 15 15:01:32.338239 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:01:32.338218 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bd7568be231cadeb7254c4652d4cc65489bfd825d24a1e1c399d2ea39ab0df0\": container with ID starting with 6bd7568be231cadeb7254c4652d4cc65489bfd825d24a1e1c399d2ea39ab0df0 not found: ID does not exist" containerID="6bd7568be231cadeb7254c4652d4cc65489bfd825d24a1e1c399d2ea39ab0df0" Jul 15 15:01:32.338312 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.338254 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bd7568be231cadeb7254c4652d4cc65489bfd825d24a1e1c399d2ea39ab0df0"} err="failed to get container status \"6bd7568be231cadeb7254c4652d4cc65489bfd825d24a1e1c399d2ea39ab0df0\": rpc error: code = NotFound desc = could not find container \"6bd7568be231cadeb7254c4652d4cc65489bfd825d24a1e1c399d2ea39ab0df0\": container with ID starting with 6bd7568be231cadeb7254c4652d4cc65489bfd825d24a1e1c399d2ea39ab0df0 not found: ID does not exist" Jul 15 15:01:32.338312 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.338298 2565 scope.go:117] "RemoveContainer" containerID="9d4a9695b3e922f4e687fcc8fc9d025f4bfdaf83e03c56d82ce60214691251dd" Jul 15 15:01:32.338558 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:01:32.338543 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d4a9695b3e922f4e687fcc8fc9d025f4bfdaf83e03c56d82ce60214691251dd\": container with ID starting with 9d4a9695b3e922f4e687fcc8fc9d025f4bfdaf83e03c56d82ce60214691251dd not found: ID does not exist" containerID="9d4a9695b3e922f4e687fcc8fc9d025f4bfdaf83e03c56d82ce60214691251dd" Jul 15 15:01:32.338615 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.338567 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4a9695b3e922f4e687fcc8fc9d025f4bfdaf83e03c56d82ce60214691251dd"} err="failed to get container status \"9d4a9695b3e922f4e687fcc8fc9d025f4bfdaf83e03c56d82ce60214691251dd\": rpc error: code = NotFound desc = could not find container \"9d4a9695b3e922f4e687fcc8fc9d025f4bfdaf83e03c56d82ce60214691251dd\": container with ID starting with 9d4a9695b3e922f4e687fcc8fc9d025f4bfdaf83e03c56d82ce60214691251dd not found: ID does not exist" Jul 15 15:01:32.343263 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.343241 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc"] Jul 15 15:01:32.347661 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.347640 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-bf27e0e8-gw-openshift-default-6c8c5b464c-z8rrc"] Jul 15 15:01:32.676643 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.676614 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dff65bf2-14da-4357-9fcb-695bc08505f2" path="/var/lib/kubelet/pods/dff65bf2-14da-4357-9fcb-695bc08505f2/volumes" Jul 15 15:01:32.944775 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.944685 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6"] Jul 15 15:01:32.945210 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.945192 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be60aa25-cb86-4d39-88fa-6bcdba88928d" containerName="istio-proxy" Jul 15 15:01:32.945272 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.945215 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="be60aa25-cb86-4d39-88fa-6bcdba88928d" containerName="istio-proxy" Jul 15 15:01:32.945272 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.945239 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be60aa25-cb86-4d39-88fa-6bcdba88928d" containerName="istio-proxy" Jul 15 15:01:32.945272 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.945249 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="be60aa25-cb86-4d39-88fa-6bcdba88928d" containerName="istio-proxy" Jul 15 15:01:32.945272 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.945261 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dff65bf2-14da-4357-9fcb-695bc08505f2" containerName="istio-proxy" Jul 15 15:01:32.945272 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.945269 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dff65bf2-14da-4357-9fcb-695bc08505f2" containerName="istio-proxy" Jul 15 15:01:32.945430 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.945350 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dff65bf2-14da-4357-9fcb-695bc08505f2" containerName="istio-proxy" Jul 15 15:01:32.945430 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.945361 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="be60aa25-cb86-4d39-88fa-6bcdba88928d" containerName="istio-proxy" Jul 15 15:01:32.949731 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.949706 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:32.952960 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.952936 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2a4ba6ba-openshift-default-dockercfg-hl64d\"" Jul 15 15:01:32.965105 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.965079 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6"] Jul 15 15:01:32.992228 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.992197 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-credential-socket\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:32.992388 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.992263 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-token\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:32.992388 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.992288 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istiod-ca-cert\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:32.992388 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.992326 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-envoy\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:32.992514 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.992428 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-data\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:32.992514 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.992487 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-podinfo\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:32.992584 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.992521 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-workload-socket\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:32.992584 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.992558 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-workload-certs\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:32.992666 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:32.992584 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4tm5\" (UniqueName: \"kubernetes.io/projected/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-kube-api-access-j4tm5\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.093720 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.093681 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-envoy\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.093946 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.093733 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-data\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.093946 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.093763 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-podinfo\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.093946 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.093782 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-workload-socket\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.093946 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.093831 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-workload-certs\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.093946 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.093849 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4tm5\" (UniqueName: \"kubernetes.io/projected/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-kube-api-access-j4tm5\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.093946 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.093889 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-credential-socket\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.094250 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.093953 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-token\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.094250 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.093975 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istiod-ca-cert\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.094363 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.094262 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-data\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.094363 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.094305 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-workload-socket\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.094468 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.094370 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-workload-certs\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.094468 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.094391 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-credential-socket\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.094716 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.094700 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istiod-ca-cert\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.096190 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.096160 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-envoy\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.096385 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.096371 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-podinfo\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.104375 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.104348 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-token\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.104472 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.104412 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4tm5\" (UniqueName: \"kubernetes.io/projected/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-kube-api-access-j4tm5\") pod \"e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.262213 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.262120 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:33.399234 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.399207 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6"] Jul 15 15:01:33.401349 ip-10-0-136-155 kubenswrapper[2565]: W0715 15:01:33.401319 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fbb58b8_b557_4632_a3ac_7108b2d8aba8.slice/crio-457108628c399ab9469c24e32ff80e9d996745c157cf3b59f437827e5e06a34b WatchSource:0}: Error finding container 457108628c399ab9469c24e32ff80e9d996745c157cf3b59f437827e5e06a34b: Status 404 returned error can't find the container with id 457108628c399ab9469c24e32ff80e9d996745c157cf3b59f437827e5e06a34b Jul 15 15:01:33.403365 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.403333 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:01:33.403460 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.403412 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:01:33.403524 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:33.403457 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:01:34.335269 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:34.335236 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" event={"ID":"1fbb58b8-b557-4632-a3ac-7108b2d8aba8","Type":"ContainerStarted","Data":"f473b0316147c60328dfe9ab6634b39a2dd887904574d86dae8af01932213a34"} Jul 15 15:01:34.335678 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:34.335283 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" event={"ID":"1fbb58b8-b557-4632-a3ac-7108b2d8aba8","Type":"ContainerStarted","Data":"457108628c399ab9469c24e32ff80e9d996745c157cf3b59f437827e5e06a34b"} Jul 15 15:01:34.427501 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:34.427450 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" podStartSLOduration=2.427433898 podStartE2EDuration="2.427433898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:01:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:01:34.42343224 +0000 UTC m=+1854.296366800" watchObservedRunningTime="2026-07-15 15:01:34.427433898 +0000 UTC m=+1854.300368457" Jul 15 15:01:35.262456 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:35.262420 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:35.267460 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:35.267434 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:35.340388 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:35.340358 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:35.341458 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:35.341435 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:47.399498 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:47.399460 2565 generic.go:356] "Generic (PLEG): container finished" podID="1fbb58b8-b557-4632-a3ac-7108b2d8aba8" containerID="f473b0316147c60328dfe9ab6634b39a2dd887904574d86dae8af01932213a34" exitCode=0 Jul 15 15:01:47.399940 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:47.399537 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" event={"ID":"1fbb58b8-b557-4632-a3ac-7108b2d8aba8","Type":"ContainerDied","Data":"f473b0316147c60328dfe9ab6634b39a2dd887904574d86dae8af01932213a34"} Jul 15 15:01:47.400094 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:47.400078 2565 scope.go:117] "RemoveContainer" containerID="f473b0316147c60328dfe9ab6634b39a2dd887904574d86dae8af01932213a34" Jul 15 15:01:47.401141 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:47.401117 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:01:47.401208 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:47.401196 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:01:47.401243 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:47.401229 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:01:48.406118 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:48.406083 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" event={"ID":"1fbb58b8-b557-4632-a3ac-7108b2d8aba8","Type":"ContainerStarted","Data":"1c653e7934abdeb2207855f14bd2715b430b3639cfe1de332341d717968cd0f9"} Jul 15 15:01:49.263256 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:49.263211 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:49.264272 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:49.264243 2565 patch_prober.go:28] interesting pod/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jul 15 15:01:49.264417 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:49.264296 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" podUID="1fbb58b8-b557-4632-a3ac-7108b2d8aba8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jul 15 15:01:50.262612 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:50.262580 2565 patch_prober.go:28] interesting pod/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jul 15 15:01:50.263036 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:50.262639 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" podUID="1fbb58b8-b557-4632-a3ac-7108b2d8aba8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jul 15 15:01:50.341930 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:50.341891 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:51.263001 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:51.262961 2565 patch_prober.go:28] interesting pod/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jul 15 15:01:51.263398 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:51.263036 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" podUID="1fbb58b8-b557-4632-a3ac-7108b2d8aba8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jul 15 15:01:52.263307 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:52.263264 2565 patch_prober.go:28] interesting pod/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jul 15 15:01:52.263739 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:52.263346 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" podUID="1fbb58b8-b557-4632-a3ac-7108b2d8aba8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jul 15 15:01:53.267074 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:53.267040 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:01:53.268145 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:01:53.268124 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:03:05.304165 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.304132 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6"] Jul 15 15:03:05.304701 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.304340 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" podUID="1fbb58b8-b557-4632-a3ac-7108b2d8aba8" containerName="istio-proxy" containerID="cri-o://1c653e7934abdeb2207855f14bd2715b430b3639cfe1de332341d717968cd0f9" gracePeriod=30 Jul 15 15:03:05.592910 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.592830 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q"] Jul 15 15:03:05.593268 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.593238 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dff65bf2-14da-4357-9fcb-695bc08505f2" containerName="istio-proxy" Jul 15 15:03:05.593268 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.593256 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dff65bf2-14da-4357-9fcb-695bc08505f2" containerName="istio-proxy" Jul 15 15:03:05.593444 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.593371 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dff65bf2-14da-4357-9fcb-695bc08505f2" containerName="istio-proxy" Jul 15 15:03:05.593444 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.593386 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="be60aa25-cb86-4d39-88fa-6bcdba88928d" containerName="istio-proxy" Jul 15 15:03:05.596359 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.596339 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.598993 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.598970 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-52ab34eb-openshift-default-dockercfg-mzz9j\"" Jul 15 15:03:05.610616 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.610585 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q"] Jul 15 15:03:05.673420 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.673383 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f33200e-9392-4390-b21c-21553a4d949a-istiod-ca-cert\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.673633 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.673476 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-workload-socket\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.673633 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.673548 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-istio-envoy\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.673633 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.673582 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnmfx\" (UniqueName: \"kubernetes.io/projected/3f33200e-9392-4390-b21c-21553a4d949a-kube-api-access-nnmfx\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.673793 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.673651 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-workload-certs\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.673793 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.673682 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-istio-data\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.673793 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.673706 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f33200e-9392-4390-b21c-21553a4d949a-istio-podinfo\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.673932 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.673795 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-credential-socket\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.673932 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.673861 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f33200e-9392-4390-b21c-21553a4d949a-istio-token\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.775222 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.775186 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-istio-envoy\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.775222 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.775225 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnmfx\" (UniqueName: \"kubernetes.io/projected/3f33200e-9392-4390-b21c-21553a4d949a-kube-api-access-nnmfx\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.775484 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.775279 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-workload-certs\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.775484 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.775322 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-istio-data\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.775484 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.775339 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f33200e-9392-4390-b21c-21553a4d949a-istio-podinfo\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.775484 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.775368 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-credential-socket\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.775484 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.775391 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f33200e-9392-4390-b21c-21553a4d949a-istio-token\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.775484 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.775457 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f33200e-9392-4390-b21c-21553a4d949a-istiod-ca-cert\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.775788 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.775542 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-workload-socket\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.775788 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.775756 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-istio-data\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.775915 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.775846 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-workload-certs\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.775915 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.775873 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-workload-socket\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.776024 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.775969 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-credential-socket\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.776383 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.776358 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f33200e-9392-4390-b21c-21553a4d949a-istiod-ca-cert\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.777502 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.777480 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-istio-envoy\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.777794 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.777776 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f33200e-9392-4390-b21c-21553a4d949a-istio-podinfo\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.784369 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.784345 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f33200e-9392-4390-b21c-21553a4d949a-istio-token\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.784652 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.784634 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnmfx\" (UniqueName: \"kubernetes.io/projected/3f33200e-9392-4390-b21c-21553a4d949a-kube-api-access-nnmfx\") pod \"e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:05.907847 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:05.907784 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:06.044471 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:06.044444 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q"] Jul 15 15:03:06.046608 ip-10-0-136-155 kubenswrapper[2565]: W0715 15:03:06.046582 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f33200e_9392_4390_b21c_21553a4d949a.slice/crio-0673e131a0a9a0e0988adb587e2c71c2026f028602793a0b7dea03443b3ebec8 WatchSource:0}: Error finding container 0673e131a0a9a0e0988adb587e2c71c2026f028602793a0b7dea03443b3ebec8: Status 404 returned error can't find the container with id 0673e131a0a9a0e0988adb587e2c71c2026f028602793a0b7dea03443b3ebec8 Jul 15 15:03:06.048587 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:06.048553 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:03:06.048697 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:06.048645 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:03:06.048697 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:06.048690 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:03:06.733662 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:06.733629 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" event={"ID":"3f33200e-9392-4390-b21c-21553a4d949a","Type":"ContainerStarted","Data":"9515f3240cfc26f2da119acc44679ef1f01431c1fe9789c06d2ebd94cc388032"} Jul 15 15:03:06.734099 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:06.733679 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" event={"ID":"3f33200e-9392-4390-b21c-21553a4d949a","Type":"ContainerStarted","Data":"0673e131a0a9a0e0988adb587e2c71c2026f028602793a0b7dea03443b3ebec8"} Jul 15 15:03:06.761109 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:06.761059 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" podStartSLOduration=1.761044735 podStartE2EDuration="1.761044735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:03:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:03:06.760493531 +0000 UTC m=+1946.633428091" watchObservedRunningTime="2026-07-15 15:03:06.761044735 +0000 UTC m=+1946.633979295" Jul 15 15:03:06.908043 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:06.908008 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:07.913100 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:07.913071 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:08.269983 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:08.269942 2565 patch_prober.go:28] interesting pod/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 15:03:08.270153 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:08.270007 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" podUID="1fbb58b8-b557-4632-a3ac-7108b2d8aba8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 15:03:08.742860 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:08.742830 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:08.743784 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:08.743766 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:10.562442 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.562418 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:03:10.720390 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.720354 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4tm5\" (UniqueName: \"kubernetes.io/projected/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-kube-api-access-j4tm5\") pod \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " Jul 15 15:03:10.720390 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.720389 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-token\") pod \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " Jul 15 15:03:10.720622 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.720408 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-podinfo\") pod \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " Jul 15 15:03:10.720622 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.720457 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-envoy\") pod \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " Jul 15 15:03:10.720622 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.720476 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-workload-socket\") pod \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " Jul 15 15:03:10.720622 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.720499 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-credential-socket\") pod \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " Jul 15 15:03:10.720622 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.720518 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-data\") pod \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " Jul 15 15:03:10.720622 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.720538 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-workload-certs\") pod \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " Jul 15 15:03:10.720622 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.720563 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istiod-ca-cert\") pod \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\" (UID: \"1fbb58b8-b557-4632-a3ac-7108b2d8aba8\") " Jul 15 15:03:10.720994 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.720848 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1fbb58b8-b557-4632-a3ac-7108b2d8aba8" (UID: "1fbb58b8-b557-4632-a3ac-7108b2d8aba8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:03:10.720994 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.720879 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1fbb58b8-b557-4632-a3ac-7108b2d8aba8" (UID: "1fbb58b8-b557-4632-a3ac-7108b2d8aba8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:03:10.721160 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.721129 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1fbb58b8-b557-4632-a3ac-7108b2d8aba8" (UID: "1fbb58b8-b557-4632-a3ac-7108b2d8aba8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:03:10.721322 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.721296 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1fbb58b8-b557-4632-a3ac-7108b2d8aba8" (UID: "1fbb58b8-b557-4632-a3ac-7108b2d8aba8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:03:10.721492 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.721469 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-data" (OuterVolumeSpecName: "istio-data") pod "1fbb58b8-b557-4632-a3ac-7108b2d8aba8" (UID: "1fbb58b8-b557-4632-a3ac-7108b2d8aba8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:03:10.722624 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.722592 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-kube-api-access-j4tm5" (OuterVolumeSpecName: "kube-api-access-j4tm5") pod "1fbb58b8-b557-4632-a3ac-7108b2d8aba8" (UID: "1fbb58b8-b557-4632-a3ac-7108b2d8aba8"). InnerVolumeSpecName "kube-api-access-j4tm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:03:10.722884 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.722858 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1fbb58b8-b557-4632-a3ac-7108b2d8aba8" (UID: "1fbb58b8-b557-4632-a3ac-7108b2d8aba8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 15:03:10.723034 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.723014 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-token" (OuterVolumeSpecName: "istio-token") pod "1fbb58b8-b557-4632-a3ac-7108b2d8aba8" (UID: "1fbb58b8-b557-4632-a3ac-7108b2d8aba8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:03:10.723112 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.723015 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1fbb58b8-b557-4632-a3ac-7108b2d8aba8" (UID: "1fbb58b8-b557-4632-a3ac-7108b2d8aba8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:03:10.752772 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.752735 2565 generic.go:356] "Generic (PLEG): container finished" podID="1fbb58b8-b557-4632-a3ac-7108b2d8aba8" containerID="1c653e7934abdeb2207855f14bd2715b430b3639cfe1de332341d717968cd0f9" exitCode=0 Jul 15 15:03:10.752984 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.752833 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" event={"ID":"1fbb58b8-b557-4632-a3ac-7108b2d8aba8","Type":"ContainerDied","Data":"1c653e7934abdeb2207855f14bd2715b430b3639cfe1de332341d717968cd0f9"} Jul 15 15:03:10.752984 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.752918 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" event={"ID":"1fbb58b8-b557-4632-a3ac-7108b2d8aba8","Type":"ContainerDied","Data":"457108628c399ab9469c24e32ff80e9d996745c157cf3b59f437827e5e06a34b"} Jul 15 15:03:10.752984 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.752842 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6" Jul 15 15:03:10.752984 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.752943 2565 scope.go:117] "RemoveContainer" containerID="1c653e7934abdeb2207855f14bd2715b430b3639cfe1de332341d717968cd0f9" Jul 15 15:03:10.762189 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.762171 2565 scope.go:117] "RemoveContainer" containerID="f473b0316147c60328dfe9ab6634b39a2dd887904574d86dae8af01932213a34" Jul 15 15:03:10.770123 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.770096 2565 scope.go:117] "RemoveContainer" containerID="1c653e7934abdeb2207855f14bd2715b430b3639cfe1de332341d717968cd0f9" Jul 15 15:03:10.770381 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:03:10.770357 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c653e7934abdeb2207855f14bd2715b430b3639cfe1de332341d717968cd0f9\": container with ID starting with 1c653e7934abdeb2207855f14bd2715b430b3639cfe1de332341d717968cd0f9 not found: ID does not exist" containerID="1c653e7934abdeb2207855f14bd2715b430b3639cfe1de332341d717968cd0f9" Jul 15 15:03:10.770448 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.770390 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c653e7934abdeb2207855f14bd2715b430b3639cfe1de332341d717968cd0f9"} err="failed to get container status \"1c653e7934abdeb2207855f14bd2715b430b3639cfe1de332341d717968cd0f9\": rpc error: code = NotFound desc = could not find container \"1c653e7934abdeb2207855f14bd2715b430b3639cfe1de332341d717968cd0f9\": container with ID starting with 1c653e7934abdeb2207855f14bd2715b430b3639cfe1de332341d717968cd0f9 not found: ID does not exist" Jul 15 15:03:10.770448 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.770407 2565 scope.go:117] "RemoveContainer" containerID="f473b0316147c60328dfe9ab6634b39a2dd887904574d86dae8af01932213a34" Jul 15 15:03:10.770645 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:03:10.770628 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f473b0316147c60328dfe9ab6634b39a2dd887904574d86dae8af01932213a34\": container with ID starting with f473b0316147c60328dfe9ab6634b39a2dd887904574d86dae8af01932213a34 not found: ID does not exist" containerID="f473b0316147c60328dfe9ab6634b39a2dd887904574d86dae8af01932213a34" Jul 15 15:03:10.770689 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.770653 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f473b0316147c60328dfe9ab6634b39a2dd887904574d86dae8af01932213a34"} err="failed to get container status \"f473b0316147c60328dfe9ab6634b39a2dd887904574d86dae8af01932213a34\": rpc error: code = NotFound desc = could not find container \"f473b0316147c60328dfe9ab6634b39a2dd887904574d86dae8af01932213a34\": container with ID starting with f473b0316147c60328dfe9ab6634b39a2dd887904574d86dae8af01932213a34 not found: ID does not exist" Jul 15 15:03:10.775183 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.775160 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6"] Jul 15 15:03:10.776598 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.776580 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2a4ba6ba-openshift-default-55d9fb6bdf-sstf6"] Jul 15 15:03:10.821616 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.821583 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4tm5\" (UniqueName: \"kubernetes.io/projected/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-kube-api-access-j4tm5\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:03:10.821616 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.821615 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-token\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:03:10.821845 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.821632 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-podinfo\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:03:10.821845 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.821646 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-envoy\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:03:10.821845 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.821658 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-workload-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:03:10.821845 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.821669 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-credential-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:03:10.821845 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.821679 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istio-data\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:03:10.821845 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.821691 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-workload-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:03:10.821845 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:10.821701 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fbb58b8-b557-4632-a3ac-7108b2d8aba8-istiod-ca-cert\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:03:12.676371 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:12.676327 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fbb58b8-b557-4632-a3ac-7108b2d8aba8" path="/var/lib/kubelet/pods/1fbb58b8-b557-4632-a3ac-7108b2d8aba8/volumes" Jul 15 15:03:20.801185 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:20.801151 2565 generic.go:356] "Generic (PLEG): container finished" podID="3f33200e-9392-4390-b21c-21553a4d949a" containerID="9515f3240cfc26f2da119acc44679ef1f01431c1fe9789c06d2ebd94cc388032" exitCode=0 Jul 15 15:03:20.801640 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:20.801207 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" event={"ID":"3f33200e-9392-4390-b21c-21553a4d949a","Type":"ContainerDied","Data":"9515f3240cfc26f2da119acc44679ef1f01431c1fe9789c06d2ebd94cc388032"} Jul 15 15:03:20.801640 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:20.801614 2565 scope.go:117] "RemoveContainer" containerID="9515f3240cfc26f2da119acc44679ef1f01431c1fe9789c06d2ebd94cc388032" Jul 15 15:03:20.802642 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:20.802607 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:03:20.802799 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:20.802691 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:03:20.802799 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:20.802738 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:03:21.807583 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:21.807545 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" event={"ID":"3f33200e-9392-4390-b21c-21553a4d949a","Type":"ContainerStarted","Data":"382dced85c2b3bb170425488517b05f822f01a9df9150f9065e384d11876a2ba"} Jul 15 15:03:21.908477 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:21.908449 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:21.909421 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:21.909396 2565 patch_prober.go:28] interesting pod/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 15 15:03:21.909507 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:21.909445 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" podUID="3f33200e-9392-4390-b21c-21553a4d949a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 15 15:03:22.908982 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:22.908938 2565 patch_prober.go:28] interesting pod/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 15 15:03:22.909484 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:22.909009 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" podUID="3f33200e-9392-4390-b21c-21553a4d949a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 15 15:03:23.743540 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:23.743492 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:23.909149 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:23.909114 2565 patch_prober.go:28] interesting pod/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 15 15:03:23.909525 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:23.909174 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" podUID="3f33200e-9392-4390-b21c-21553a4d949a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 15 15:03:24.908573 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:24.908539 2565 patch_prober.go:28] interesting pod/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 15 15:03:24.908737 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:24.908596 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" podUID="3f33200e-9392-4390-b21c-21553a4d949a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 15 15:03:25.912865 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:25.912832 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:03:25.914031 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:03:25.914010 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:04:36.428094 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:36.428056 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q"] Jul 15 15:04:36.428668 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:36.428248 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" podUID="3f33200e-9392-4390-b21c-21553a4d949a" containerName="istio-proxy" containerID="cri-o://382dced85c2b3bb170425488517b05f822f01a9df9150f9065e384d11876a2ba" gracePeriod=30 Jul 15 15:04:40.915709 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:40.915672 2565 patch_prober.go:28] interesting pod/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 15:04:40.916101 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:40.915733 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" podUID="3f33200e-9392-4390-b21c-21553a4d949a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 15:04:41.678727 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.678700 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:04:41.770385 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.770360 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-workload-socket\") pod \"3f33200e-9392-4390-b21c-21553a4d949a\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " Jul 15 15:04:41.770536 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.770393 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-istio-envoy\") pod \"3f33200e-9392-4390-b21c-21553a4d949a\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " Jul 15 15:04:41.770536 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.770417 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-credential-socket\") pod \"3f33200e-9392-4390-b21c-21553a4d949a\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " Jul 15 15:04:41.770536 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.770450 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f33200e-9392-4390-b21c-21553a4d949a-istiod-ca-cert\") pod \"3f33200e-9392-4390-b21c-21553a4d949a\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " Jul 15 15:04:41.770536 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.770481 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f33200e-9392-4390-b21c-21553a4d949a-istio-token\") pod \"3f33200e-9392-4390-b21c-21553a4d949a\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " Jul 15 15:04:41.770536 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.770524 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-istio-data\") pod \"3f33200e-9392-4390-b21c-21553a4d949a\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " Jul 15 15:04:41.770785 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.770581 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnmfx\" (UniqueName: \"kubernetes.io/projected/3f33200e-9392-4390-b21c-21553a4d949a-kube-api-access-nnmfx\") pod \"3f33200e-9392-4390-b21c-21553a4d949a\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " Jul 15 15:04:41.770785 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.770603 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-workload-certs\") pod \"3f33200e-9392-4390-b21c-21553a4d949a\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " Jul 15 15:04:41.770785 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.770626 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f33200e-9392-4390-b21c-21553a4d949a-istio-podinfo\") pod \"3f33200e-9392-4390-b21c-21553a4d949a\" (UID: \"3f33200e-9392-4390-b21c-21553a4d949a\") " Jul 15 15:04:41.770785 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.770710 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f33200e-9392-4390-b21c-21553a4d949a" (UID: "3f33200e-9392-4390-b21c-21553a4d949a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:04:41.770785 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.770735 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f33200e-9392-4390-b21c-21553a4d949a" (UID: "3f33200e-9392-4390-b21c-21553a4d949a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:04:41.771063 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.770927 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f33200e-9392-4390-b21c-21553a4d949a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f33200e-9392-4390-b21c-21553a4d949a" (UID: "3f33200e-9392-4390-b21c-21553a4d949a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:04:41.771063 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.770935 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f33200e-9392-4390-b21c-21553a4d949a" (UID: "3f33200e-9392-4390-b21c-21553a4d949a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:04:41.771063 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.770996 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-workload-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:04:41.771063 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.771016 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-credential-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:04:41.771659 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.771637 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f33200e-9392-4390-b21c-21553a4d949a" (UID: "3f33200e-9392-4390-b21c-21553a4d949a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:04:41.772671 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.772650 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f33200e-9392-4390-b21c-21553a4d949a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f33200e-9392-4390-b21c-21553a4d949a" (UID: "3f33200e-9392-4390-b21c-21553a4d949a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 15:04:41.773199 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.773170 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f33200e-9392-4390-b21c-21553a4d949a-kube-api-access-nnmfx" (OuterVolumeSpecName: "kube-api-access-nnmfx") pod "3f33200e-9392-4390-b21c-21553a4d949a" (UID: "3f33200e-9392-4390-b21c-21553a4d949a"). InnerVolumeSpecName "kube-api-access-nnmfx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:04:41.773199 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.773186 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f33200e-9392-4390-b21c-21553a4d949a-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f33200e-9392-4390-b21c-21553a4d949a" (UID: "3f33200e-9392-4390-b21c-21553a4d949a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:04:41.773608 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.773591 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f33200e-9392-4390-b21c-21553a4d949a" (UID: "3f33200e-9392-4390-b21c-21553a4d949a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:04:41.871962 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.871927 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-istio-envoy\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:04:41.871962 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.871955 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f33200e-9392-4390-b21c-21553a4d949a-istiod-ca-cert\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:04:41.871962 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.871966 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f33200e-9392-4390-b21c-21553a4d949a-istio-token\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:04:41.871962 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.871973 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-istio-data\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:04:41.872217 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.871981 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnmfx\" (UniqueName: \"kubernetes.io/projected/3f33200e-9392-4390-b21c-21553a4d949a-kube-api-access-nnmfx\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:04:41.872217 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.871992 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f33200e-9392-4390-b21c-21553a4d949a-workload-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:04:41.872217 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:41.872000 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f33200e-9392-4390-b21c-21553a4d949a-istio-podinfo\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:04:42.146799 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:42.146765 2565 generic.go:356] "Generic (PLEG): container finished" podID="3f33200e-9392-4390-b21c-21553a4d949a" containerID="382dced85c2b3bb170425488517b05f822f01a9df9150f9065e384d11876a2ba" exitCode=0 Jul 15 15:04:42.147374 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:42.146846 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" event={"ID":"3f33200e-9392-4390-b21c-21553a4d949a","Type":"ContainerDied","Data":"382dced85c2b3bb170425488517b05f822f01a9df9150f9065e384d11876a2ba"} Jul 15 15:04:42.147374 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:42.146921 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" event={"ID":"3f33200e-9392-4390-b21c-21553a4d949a","Type":"ContainerDied","Data":"0673e131a0a9a0e0988adb587e2c71c2026f028602793a0b7dea03443b3ebec8"} Jul 15 15:04:42.147374 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:42.146860 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q" Jul 15 15:04:42.147374 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:42.146944 2565 scope.go:117] "RemoveContainer" containerID="382dced85c2b3bb170425488517b05f822f01a9df9150f9065e384d11876a2ba" Jul 15 15:04:42.155562 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:42.155546 2565 scope.go:117] "RemoveContainer" containerID="9515f3240cfc26f2da119acc44679ef1f01431c1fe9789c06d2ebd94cc388032" Jul 15 15:04:42.162659 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:42.162644 2565 scope.go:117] "RemoveContainer" containerID="382dced85c2b3bb170425488517b05f822f01a9df9150f9065e384d11876a2ba" Jul 15 15:04:42.162931 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:04:42.162909 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"382dced85c2b3bb170425488517b05f822f01a9df9150f9065e384d11876a2ba\": container with ID starting with 382dced85c2b3bb170425488517b05f822f01a9df9150f9065e384d11876a2ba not found: ID does not exist" containerID="382dced85c2b3bb170425488517b05f822f01a9df9150f9065e384d11876a2ba" Jul 15 15:04:42.163030 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:42.162936 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"382dced85c2b3bb170425488517b05f822f01a9df9150f9065e384d11876a2ba"} err="failed to get container status \"382dced85c2b3bb170425488517b05f822f01a9df9150f9065e384d11876a2ba\": rpc error: code = NotFound desc = could not find container \"382dced85c2b3bb170425488517b05f822f01a9df9150f9065e384d11876a2ba\": container with ID starting with 382dced85c2b3bb170425488517b05f822f01a9df9150f9065e384d11876a2ba not found: ID does not exist" Jul 15 15:04:42.163030 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:42.162954 2565 scope.go:117] "RemoveContainer" containerID="9515f3240cfc26f2da119acc44679ef1f01431c1fe9789c06d2ebd94cc388032" Jul 15 15:04:42.163201 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:04:42.163183 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9515f3240cfc26f2da119acc44679ef1f01431c1fe9789c06d2ebd94cc388032\": container with ID starting with 9515f3240cfc26f2da119acc44679ef1f01431c1fe9789c06d2ebd94cc388032 not found: ID does not exist" containerID="9515f3240cfc26f2da119acc44679ef1f01431c1fe9789c06d2ebd94cc388032" Jul 15 15:04:42.163243 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:42.163207 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9515f3240cfc26f2da119acc44679ef1f01431c1fe9789c06d2ebd94cc388032"} err="failed to get container status \"9515f3240cfc26f2da119acc44679ef1f01431c1fe9789c06d2ebd94cc388032\": rpc error: code = NotFound desc = could not find container \"9515f3240cfc26f2da119acc44679ef1f01431c1fe9789c06d2ebd94cc388032\": container with ID starting with 9515f3240cfc26f2da119acc44679ef1f01431c1fe9789c06d2ebd94cc388032 not found: ID does not exist" Jul 15 15:04:42.169673 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:42.169651 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q"] Jul 15 15:04:42.178767 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:42.178746 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-52ab34eb-openshift-default-58b97c4b8c-lqb2q"] Jul 15 15:04:42.676609 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:04:42.676577 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f33200e-9392-4390-b21c-21553a4d949a" path="/var/lib/kubelet/pods/3f33200e-9392-4390-b21c-21553a4d949a/volumes" Jul 15 15:06:11.996317 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:11.996277 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w"] Jul 15 15:06:11.996775 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:11.996648 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fbb58b8-b557-4632-a3ac-7108b2d8aba8" containerName="istio-proxy" Jul 15 15:06:11.996775 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:11.996660 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fbb58b8-b557-4632-a3ac-7108b2d8aba8" containerName="istio-proxy" Jul 15 15:06:11.996775 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:11.996671 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f33200e-9392-4390-b21c-21553a4d949a" containerName="istio-proxy" Jul 15 15:06:11.996775 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:11.996679 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f33200e-9392-4390-b21c-21553a4d949a" containerName="istio-proxy" Jul 15 15:06:11.996775 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:11.996690 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fbb58b8-b557-4632-a3ac-7108b2d8aba8" containerName="istio-proxy" Jul 15 15:06:11.996775 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:11.996697 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fbb58b8-b557-4632-a3ac-7108b2d8aba8" containerName="istio-proxy" Jul 15 15:06:11.996775 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:11.996754 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fbb58b8-b557-4632-a3ac-7108b2d8aba8" containerName="istio-proxy" Jul 15 15:06:11.996775 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:11.996761 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f33200e-9392-4390-b21c-21553a4d949a" containerName="istio-proxy" Jul 15 15:06:12.005905 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:11.999695 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.005905 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.005610 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c91d77b6-openshift-default-dockercfg-rhlwk\"" Jul 15 15:06:12.018794 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.018770 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w"] Jul 15 15:06:12.183111 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.183071 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-data\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.183297 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.183124 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-envoy\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.183297 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.183182 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-token\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.183297 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.183220 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z78s7\" (UniqueName: \"kubernetes.io/projected/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-kube-api-access-z78s7\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.183297 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.183293 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-credential-socket\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.183430 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.183313 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-podinfo\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.183430 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.183339 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istiod-ca-cert\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.183430 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.183356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-workload-certs\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.183430 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.183373 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-workload-socket\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.284773 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.284666 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-data\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.284773 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.284743 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-envoy\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.284773 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.284777 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-token\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.285072 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.284855 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z78s7\" (UniqueName: \"kubernetes.io/projected/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-kube-api-access-z78s7\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.285072 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.284932 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-credential-socket\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.285072 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.284957 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-podinfo\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.285072 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.284986 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istiod-ca-cert\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.285287 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.285080 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-workload-certs\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.285287 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.285126 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-workload-socket\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.285287 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.285135 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-data\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.285287 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.285272 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-credential-socket\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.285486 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.285465 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-workload-certs\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.285561 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.285524 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-workload-socket\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.285696 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.285668 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istiod-ca-cert\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.287007 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.286989 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-envoy\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.287437 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.287422 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-podinfo\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.292653 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.292627 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z78s7\" (UniqueName: \"kubernetes.io/projected/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-kube-api-access-z78s7\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.292976 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.292959 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-token\") pod \"e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.312002 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.311968 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:12.448508 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.448478 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w"] Jul 15 15:06:12.450729 ip-10-0-136-155 kubenswrapper[2565]: W0715 15:06:12.450697 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4bc6584_5ab6_495b_aabf_0a7803a3d7e1.slice/crio-464a6ba5478d9c2728b4bf1ba7b13198489575d4d5c951661177e622df809f73 WatchSource:0}: Error finding container 464a6ba5478d9c2728b4bf1ba7b13198489575d4d5c951661177e622df809f73: Status 404 returned error can't find the container with id 464a6ba5478d9c2728b4bf1ba7b13198489575d4d5c951661177e622df809f73 Jul 15 15:06:12.453046 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.453001 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:06:12.453147 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.453089 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:06:12.453147 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.453118 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:06:12.535075 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.534983 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" event={"ID":"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1","Type":"ContainerStarted","Data":"fef99236b7cb1c16ec0c7cd9f021123221d799b3f4c925c71978ca1c8e522ab3"} Jul 15 15:06:12.535075 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.535052 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" event={"ID":"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1","Type":"ContainerStarted","Data":"464a6ba5478d9c2728b4bf1ba7b13198489575d4d5c951661177e622df809f73"} Jul 15 15:06:12.559856 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:12.559784 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" podStartSLOduration=1.559767045 podStartE2EDuration="1.559767045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:06:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:06:12.559079328 +0000 UTC m=+2132.432013890" watchObservedRunningTime="2026-07-15 15:06:12.559767045 +0000 UTC m=+2132.432701605" Jul 15 15:06:13.312387 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:13.312352 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:13.317446 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:13.317418 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:13.539337 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:13.539307 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:13.540345 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:13.540327 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:28.888626 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:28.888576 2565 patch_prober.go:28] interesting pod/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": read tcp 10.133.0.2:33968->10.133.0.27:15021: read: connection reset by peer" start-of-body= Jul 15 15:06:28.889052 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:28.888645 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" podUID="d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": read tcp 10.133.0.2:33968->10.133.0.27:15021: read: connection reset by peer" Jul 15 15:06:29.608309 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:29.608273 2565 generic.go:356] "Generic (PLEG): container finished" podID="d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" containerID="fef99236b7cb1c16ec0c7cd9f021123221d799b3f4c925c71978ca1c8e522ab3" exitCode=0 Jul 15 15:06:29.608504 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:29.608346 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" event={"ID":"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1","Type":"ContainerDied","Data":"fef99236b7cb1c16ec0c7cd9f021123221d799b3f4c925c71978ca1c8e522ab3"} Jul 15 15:06:29.608795 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:29.608779 2565 scope.go:117] "RemoveContainer" containerID="fef99236b7cb1c16ec0c7cd9f021123221d799b3f4c925c71978ca1c8e522ab3" Jul 15 15:06:29.609832 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:29.609790 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:06:29.609929 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:29.609889 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:06:29.609991 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:29.609938 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:06:30.614602 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:30.614562 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" event={"ID":"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1","Type":"ContainerStarted","Data":"fb57ab1f3c32a137908e19b2f639de995f882b1c2a75988e31f8c79775ef8ea7"} Jul 15 15:06:31.313023 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:31.312987 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:31.313269 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:31.313246 2565 patch_prober.go:28] interesting pod/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 15 15:06:31.313315 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:31.313296 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" podUID="d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 15 15:06:32.313097 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:32.313007 2565 patch_prober.go:28] interesting pod/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 15 15:06:32.313097 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:32.313075 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" podUID="d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 15 15:06:33.313087 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:33.313047 2565 patch_prober.go:28] interesting pod/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 15 15:06:33.313284 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:33.313114 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" podUID="d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 15 15:06:34.312595 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:34.312551 2565 patch_prober.go:28] interesting pod/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 15 15:06:34.312833 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:34.312613 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" podUID="d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 15 15:06:35.316212 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:35.316181 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:35.316683 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:35.316468 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:35.317089 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:35.317073 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:52.163724 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:52.163687 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w"] Jul 15 15:06:52.164256 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:52.163961 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" podUID="d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" containerName="istio-proxy" containerID="cri-o://fb57ab1f3c32a137908e19b2f639de995f882b1c2a75988e31f8c79775ef8ea7" gracePeriod=30 Jul 15 15:06:57.416052 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.416027 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:57.503732 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.503638 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-token\") pod \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " Jul 15 15:06:57.503732 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.503678 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-workload-socket\") pod \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " Jul 15 15:06:57.503732 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.503695 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z78s7\" (UniqueName: \"kubernetes.io/projected/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-kube-api-access-z78s7\") pod \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " Jul 15 15:06:57.503732 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.503711 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-workload-certs\") pod \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " Jul 15 15:06:57.503732 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.503728 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-envoy\") pod \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " Jul 15 15:06:57.504160 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.503829 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-credential-socket\") pod \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " Jul 15 15:06:57.504160 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.503884 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-data\") pod \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " Jul 15 15:06:57.504160 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.503908 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istiod-ca-cert\") pod \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " Jul 15 15:06:57.504160 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.503947 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-podinfo\") pod \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\" (UID: \"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1\") " Jul 15 15:06:57.504160 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.504034 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" (UID: "d4bc6584-5ab6-495b-aabf-0a7803a3d7e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:06:57.504160 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.504095 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" (UID: "d4bc6584-5ab6-495b-aabf-0a7803a3d7e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:06:57.504455 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.504216 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" (UID: "d4bc6584-5ab6-495b-aabf-0a7803a3d7e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:06:57.504455 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.504252 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-workload-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:06:57.504455 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.504277 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-workload-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:06:57.504455 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.504423 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" (UID: "d4bc6584-5ab6-495b-aabf-0a7803a3d7e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:06:57.504938 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.504917 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" (UID: "d4bc6584-5ab6-495b-aabf-0a7803a3d7e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:06:57.506083 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.506059 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" (UID: "d4bc6584-5ab6-495b-aabf-0a7803a3d7e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:06:57.506190 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.506113 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-kube-api-access-z78s7" (OuterVolumeSpecName: "kube-api-access-z78s7") pod "d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" (UID: "d4bc6584-5ab6-495b-aabf-0a7803a3d7e1"). InnerVolumeSpecName "kube-api-access-z78s7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:06:57.506282 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.506264 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" (UID: "d4bc6584-5ab6-495b-aabf-0a7803a3d7e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:06:57.506396 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.506380 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" (UID: "d4bc6584-5ab6-495b-aabf-0a7803a3d7e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 15:06:57.605094 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.605054 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-token\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:06:57.605094 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.605088 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z78s7\" (UniqueName: \"kubernetes.io/projected/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-kube-api-access-z78s7\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:06:57.605094 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.605102 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-envoy\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:06:57.605343 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.605116 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-credential-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:06:57.605343 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.605126 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-data\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:06:57.605343 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.605138 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istiod-ca-cert\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:06:57.605343 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.605148 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1-istio-podinfo\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:06:57.725551 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.725520 2565 generic.go:356] "Generic (PLEG): container finished" podID="d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" containerID="fb57ab1f3c32a137908e19b2f639de995f882b1c2a75988e31f8c79775ef8ea7" exitCode=0 Jul 15 15:06:57.725729 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.725568 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" Jul 15 15:06:57.725729 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.725610 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" event={"ID":"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1","Type":"ContainerDied","Data":"fb57ab1f3c32a137908e19b2f639de995f882b1c2a75988e31f8c79775ef8ea7"} Jul 15 15:06:57.725729 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.725661 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w" event={"ID":"d4bc6584-5ab6-495b-aabf-0a7803a3d7e1","Type":"ContainerDied","Data":"464a6ba5478d9c2728b4bf1ba7b13198489575d4d5c951661177e622df809f73"} Jul 15 15:06:57.725729 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.725683 2565 scope.go:117] "RemoveContainer" containerID="fb57ab1f3c32a137908e19b2f639de995f882b1c2a75988e31f8c79775ef8ea7" Jul 15 15:06:57.734955 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.734940 2565 scope.go:117] "RemoveContainer" containerID="fef99236b7cb1c16ec0c7cd9f021123221d799b3f4c925c71978ca1c8e522ab3" Jul 15 15:06:57.742550 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.742531 2565 scope.go:117] "RemoveContainer" containerID="fb57ab1f3c32a137908e19b2f639de995f882b1c2a75988e31f8c79775ef8ea7" Jul 15 15:06:57.742832 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:06:57.742790 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb57ab1f3c32a137908e19b2f639de995f882b1c2a75988e31f8c79775ef8ea7\": container with ID starting with fb57ab1f3c32a137908e19b2f639de995f882b1c2a75988e31f8c79775ef8ea7 not found: ID does not exist" containerID="fb57ab1f3c32a137908e19b2f639de995f882b1c2a75988e31f8c79775ef8ea7" Jul 15 15:06:57.742916 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.742839 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb57ab1f3c32a137908e19b2f639de995f882b1c2a75988e31f8c79775ef8ea7"} err="failed to get container status \"fb57ab1f3c32a137908e19b2f639de995f882b1c2a75988e31f8c79775ef8ea7\": rpc error: code = NotFound desc = could not find container \"fb57ab1f3c32a137908e19b2f639de995f882b1c2a75988e31f8c79775ef8ea7\": container with ID starting with fb57ab1f3c32a137908e19b2f639de995f882b1c2a75988e31f8c79775ef8ea7 not found: ID does not exist" Jul 15 15:06:57.742916 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.742865 2565 scope.go:117] "RemoveContainer" containerID="fef99236b7cb1c16ec0c7cd9f021123221d799b3f4c925c71978ca1c8e522ab3" Jul 15 15:06:57.743115 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:06:57.743093 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fef99236b7cb1c16ec0c7cd9f021123221d799b3f4c925c71978ca1c8e522ab3\": container with ID starting with fef99236b7cb1c16ec0c7cd9f021123221d799b3f4c925c71978ca1c8e522ab3 not found: ID does not exist" containerID="fef99236b7cb1c16ec0c7cd9f021123221d799b3f4c925c71978ca1c8e522ab3" Jul 15 15:06:57.743166 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.743124 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fef99236b7cb1c16ec0c7cd9f021123221d799b3f4c925c71978ca1c8e522ab3"} err="failed to get container status \"fef99236b7cb1c16ec0c7cd9f021123221d799b3f4c925c71978ca1c8e522ab3\": rpc error: code = NotFound desc = could not find container \"fef99236b7cb1c16ec0c7cd9f021123221d799b3f4c925c71978ca1c8e522ab3\": container with ID starting with fef99236b7cb1c16ec0c7cd9f021123221d799b3f4c925c71978ca1c8e522ab3 not found: ID does not exist" Jul 15 15:06:57.746705 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.746684 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w"] Jul 15 15:06:57.753478 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:57.753457 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c91d77b6-openshift-default-85bddc9499-s4p7w"] Jul 15 15:06:58.676573 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:06:58.676525 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" path="/var/lib/kubelet/pods/d4bc6584-5ab6-495b-aabf-0a7803a3d7e1/volumes" Jul 15 15:07:11.849492 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.849459 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt"] Jul 15 15:07:11.849910 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.849772 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" containerName="istio-proxy" Jul 15 15:07:11.849910 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.849784 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" containerName="istio-proxy" Jul 15 15:07:11.849910 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.849795 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" containerName="istio-proxy" Jul 15 15:07:11.849910 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.849800 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" containerName="istio-proxy" Jul 15 15:07:11.849910 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.849828 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f33200e-9392-4390-b21c-21553a4d949a" containerName="istio-proxy" Jul 15 15:07:11.849910 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.849835 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f33200e-9392-4390-b21c-21553a4d949a" containerName="istio-proxy" Jul 15 15:07:11.849910 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.849893 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fbb58b8-b557-4632-a3ac-7108b2d8aba8" containerName="istio-proxy" Jul 15 15:07:11.849910 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.849900 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f33200e-9392-4390-b21c-21553a4d949a" containerName="istio-proxy" Jul 15 15:07:11.849910 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.849906 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" containerName="istio-proxy" Jul 15 15:07:11.849910 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.849913 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4bc6584-5ab6-495b-aabf-0a7803a3d7e1" containerName="istio-proxy" Jul 15 15:07:11.852554 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.852536 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:11.855082 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.855060 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ef5b05d8-openshift-default-dockercfg-x2hhf\"" Jul 15 15:07:11.866477 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.866451 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt"] Jul 15 15:07:11.932058 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.932020 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-workload-certs\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:11.932058 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.932059 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f4111ce-828e-43e8-9515-ec9ad762010e-istiod-ca-cert\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:11.932328 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.932087 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-token\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:11.932328 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.932172 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-podinfo\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:11.932328 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.932219 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cpqh\" (UniqueName: \"kubernetes.io/projected/3f4111ce-828e-43e8-9515-ec9ad762010e-kube-api-access-9cpqh\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:11.932328 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.932304 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-workload-socket\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:11.932540 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.932332 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-credential-socket\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:11.932540 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.932347 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-data\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:11.932540 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:11.932408 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-envoy\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.033492 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.033450 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-token\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.033680 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.033508 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-podinfo\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.033680 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.033530 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cpqh\" (UniqueName: \"kubernetes.io/projected/3f4111ce-828e-43e8-9515-ec9ad762010e-kube-api-access-9cpqh\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.033680 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.033617 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-workload-socket\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.033680 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.033655 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-credential-socket\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.033680 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.033679 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-data\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.034000 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.033721 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-envoy\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.034000 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.033761 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-workload-certs\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.034000 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.033786 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f4111ce-828e-43e8-9515-ec9ad762010e-istiod-ca-cert\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.034199 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.034173 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-credential-socket\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.034339 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.034313 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-data\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.034430 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.034321 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-workload-certs\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.034492 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.034462 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-workload-socket\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.034553 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.034538 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f4111ce-828e-43e8-9515-ec9ad762010e-istiod-ca-cert\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.036114 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.036092 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-envoy\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.036232 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.036159 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-podinfo\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.045126 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.045098 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-token\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.045434 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.045407 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cpqh\" (UniqueName: \"kubernetes.io/projected/3f4111ce-828e-43e8-9515-ec9ad762010e-kube-api-access-9cpqh\") pod \"e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.162266 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.162232 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:12.295252 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.295223 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt"] Jul 15 15:07:12.297757 ip-10-0-136-155 kubenswrapper[2565]: W0715 15:07:12.297730 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f4111ce_828e_43e8_9515_ec9ad762010e.slice/crio-9f618b57f072ceebfc8690ccceaa48c2e10495fa0d84cbe62f4fb9db0a2aedb2 WatchSource:0}: Error finding container 9f618b57f072ceebfc8690ccceaa48c2e10495fa0d84cbe62f4fb9db0a2aedb2: Status 404 returned error can't find the container with id 9f618b57f072ceebfc8690ccceaa48c2e10495fa0d84cbe62f4fb9db0a2aedb2 Jul 15 15:07:12.299871 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.299836 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:07:12.299983 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.299910 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:07:12.299983 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.299956 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:07:12.790151 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.790113 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" event={"ID":"3f4111ce-828e-43e8-9515-ec9ad762010e","Type":"ContainerStarted","Data":"71f4ce7a4f02cc996b4d08ffed566dcafd0bfc086278108677b8d13f1eadfe63"} Jul 15 15:07:12.790300 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.790174 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" event={"ID":"3f4111ce-828e-43e8-9515-ec9ad762010e","Type":"ContainerStarted","Data":"9f618b57f072ceebfc8690ccceaa48c2e10495fa0d84cbe62f4fb9db0a2aedb2"} Jul 15 15:07:12.812630 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:12.812580 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" podStartSLOduration=1.812563291 podStartE2EDuration="1.812563291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:07:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:07:12.810383545 +0000 UTC m=+2192.683318105" watchObservedRunningTime="2026-07-15 15:07:12.812563291 +0000 UTC m=+2192.685497907" Jul 15 15:07:13.162634 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:13.162601 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:13.167324 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:13.167301 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:13.794654 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:13.794624 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:13.795534 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:13.795513 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:29.294496 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:29.294460 2565 patch_prober.go:28] interesting pod/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": read tcp 10.133.0.2:46400->10.133.0.28:15021: read: connection reset by peer" start-of-body= Jul 15 15:07:29.294930 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:29.294568 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" podUID="3f4111ce-828e-43e8-9515-ec9ad762010e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": read tcp 10.133.0.2:46400->10.133.0.28:15021: read: connection reset by peer" Jul 15 15:07:29.874796 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:29.874764 2565 generic.go:356] "Generic (PLEG): container finished" podID="3f4111ce-828e-43e8-9515-ec9ad762010e" containerID="71f4ce7a4f02cc996b4d08ffed566dcafd0bfc086278108677b8d13f1eadfe63" exitCode=0 Jul 15 15:07:29.874999 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:29.874849 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" event={"ID":"3f4111ce-828e-43e8-9515-ec9ad762010e","Type":"ContainerDied","Data":"71f4ce7a4f02cc996b4d08ffed566dcafd0bfc086278108677b8d13f1eadfe63"} Jul 15 15:07:29.875273 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:29.875256 2565 scope.go:117] "RemoveContainer" containerID="71f4ce7a4f02cc996b4d08ffed566dcafd0bfc086278108677b8d13f1eadfe63" Jul 15 15:07:29.876244 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:29.876219 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:07:29.876305 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:29.876293 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:07:29.876343 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:29.876328 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:07:30.881338 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:30.881294 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" event={"ID":"3f4111ce-828e-43e8-9515-ec9ad762010e","Type":"ContainerStarted","Data":"b793bcbfafe868118f2aa9150915a660433dd5c5ceff300717c3b53521bce3b9"} Jul 15 15:07:31.162532 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:31.162489 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:31.162745 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:31.162723 2565 patch_prober.go:28] interesting pod/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 15 15:07:31.162794 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:31.162768 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" podUID="3f4111ce-828e-43e8-9515-ec9ad762010e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 15 15:07:32.163134 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:32.163099 2565 patch_prober.go:28] interesting pod/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 15 15:07:32.163539 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:32.163156 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" podUID="3f4111ce-828e-43e8-9515-ec9ad762010e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 15 15:07:33.163588 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:33.163542 2565 patch_prober.go:28] interesting pod/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 15 15:07:33.164037 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:33.163615 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" podUID="3f4111ce-828e-43e8-9515-ec9ad762010e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 15 15:07:34.162690 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:34.162655 2565 patch_prober.go:28] interesting pod/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 15 15:07:34.162897 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:34.162712 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" podUID="3f4111ce-828e-43e8-9515-ec9ad762010e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 15 15:07:35.166310 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:35.166283 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:35.166738 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:35.166549 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:07:35.167196 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:07:35.167179 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:09:09.568763 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:09.568728 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt"] Jul 15 15:09:09.569288 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:09.569029 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" podUID="3f4111ce-828e-43e8-9515-ec9ad762010e" containerName="istio-proxy" containerID="cri-o://b793bcbfafe868118f2aa9150915a660433dd5c5ceff300717c3b53521bce3b9" gracePeriod=30 Jul 15 15:09:14.814024 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.813997 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:09:14.843870 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.843786 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cpqh\" (UniqueName: \"kubernetes.io/projected/3f4111ce-828e-43e8-9515-ec9ad762010e-kube-api-access-9cpqh\") pod \"3f4111ce-828e-43e8-9515-ec9ad762010e\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " Jul 15 15:09:14.843870 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.843851 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-workload-certs\") pod \"3f4111ce-828e-43e8-9515-ec9ad762010e\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " Jul 15 15:09:14.843870 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.843872 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-workload-socket\") pod \"3f4111ce-828e-43e8-9515-ec9ad762010e\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " Jul 15 15:09:14.844135 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.843889 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-data\") pod \"3f4111ce-828e-43e8-9515-ec9ad762010e\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " Jul 15 15:09:14.844135 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.843914 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f4111ce-828e-43e8-9515-ec9ad762010e-istiod-ca-cert\") pod \"3f4111ce-828e-43e8-9515-ec9ad762010e\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " Jul 15 15:09:14.844135 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.843945 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-credential-socket\") pod \"3f4111ce-828e-43e8-9515-ec9ad762010e\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " Jul 15 15:09:14.844135 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.843994 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-token\") pod \"3f4111ce-828e-43e8-9515-ec9ad762010e\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " Jul 15 15:09:14.844135 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.844017 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-podinfo\") pod \"3f4111ce-828e-43e8-9515-ec9ad762010e\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " Jul 15 15:09:14.844135 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.844038 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-envoy\") pod \"3f4111ce-828e-43e8-9515-ec9ad762010e\" (UID: \"3f4111ce-828e-43e8-9515-ec9ad762010e\") " Jul 15 15:09:14.844442 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.844201 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f4111ce-828e-43e8-9515-ec9ad762010e" (UID: "3f4111ce-828e-43e8-9515-ec9ad762010e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:09:14.844442 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.844244 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f4111ce-828e-43e8-9515-ec9ad762010e" (UID: "3f4111ce-828e-43e8-9515-ec9ad762010e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:09:14.844442 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.844341 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f4111ce-828e-43e8-9515-ec9ad762010e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f4111ce-828e-43e8-9515-ec9ad762010e" (UID: "3f4111ce-828e-43e8-9515-ec9ad762010e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:09:14.844600 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.844468 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-workload-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:09:14.844600 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.844485 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-workload-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:09:14.844600 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.844499 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f4111ce-828e-43e8-9515-ec9ad762010e-istiod-ca-cert\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:09:14.844600 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.844584 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f4111ce-828e-43e8-9515-ec9ad762010e" (UID: "3f4111ce-828e-43e8-9515-ec9ad762010e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:09:14.844995 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.844971 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f4111ce-828e-43e8-9515-ec9ad762010e" (UID: "3f4111ce-828e-43e8-9515-ec9ad762010e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:09:14.846299 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.846274 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f4111ce-828e-43e8-9515-ec9ad762010e" (UID: "3f4111ce-828e-43e8-9515-ec9ad762010e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:09:14.846390 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.846302 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f4111ce-828e-43e8-9515-ec9ad762010e-kube-api-access-9cpqh" (OuterVolumeSpecName: "kube-api-access-9cpqh") pod "3f4111ce-828e-43e8-9515-ec9ad762010e" (UID: "3f4111ce-828e-43e8-9515-ec9ad762010e"). InnerVolumeSpecName "kube-api-access-9cpqh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:09:14.846742 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.846718 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f4111ce-828e-43e8-9515-ec9ad762010e" (UID: "3f4111ce-828e-43e8-9515-ec9ad762010e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 15:09:14.846742 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.846718 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f4111ce-828e-43e8-9515-ec9ad762010e" (UID: "3f4111ce-828e-43e8-9515-ec9ad762010e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:09:14.945317 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.945280 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cpqh\" (UniqueName: \"kubernetes.io/projected/3f4111ce-828e-43e8-9515-ec9ad762010e-kube-api-access-9cpqh\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:09:14.945317 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.945312 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-data\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:09:14.945317 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.945322 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-credential-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:09:14.945545 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.945335 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-token\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:09:14.945545 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.945346 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-podinfo\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:09:14.945545 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:14.945356 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f4111ce-828e-43e8-9515-ec9ad762010e-istio-envoy\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:09:15.320506 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:15.320471 2565 generic.go:356] "Generic (PLEG): container finished" podID="3f4111ce-828e-43e8-9515-ec9ad762010e" containerID="b793bcbfafe868118f2aa9150915a660433dd5c5ceff300717c3b53521bce3b9" exitCode=0 Jul 15 15:09:15.320704 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:15.320525 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" Jul 15 15:09:15.320704 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:15.320553 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" event={"ID":"3f4111ce-828e-43e8-9515-ec9ad762010e","Type":"ContainerDied","Data":"b793bcbfafe868118f2aa9150915a660433dd5c5ceff300717c3b53521bce3b9"} Jul 15 15:09:15.320704 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:15.320608 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt" event={"ID":"3f4111ce-828e-43e8-9515-ec9ad762010e","Type":"ContainerDied","Data":"9f618b57f072ceebfc8690ccceaa48c2e10495fa0d84cbe62f4fb9db0a2aedb2"} Jul 15 15:09:15.320704 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:15.320634 2565 scope.go:117] "RemoveContainer" containerID="b793bcbfafe868118f2aa9150915a660433dd5c5ceff300717c3b53521bce3b9" Jul 15 15:09:15.329979 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:15.329961 2565 scope.go:117] "RemoveContainer" containerID="71f4ce7a4f02cc996b4d08ffed566dcafd0bfc086278108677b8d13f1eadfe63" Jul 15 15:09:15.338021 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:15.337999 2565 scope.go:117] "RemoveContainer" containerID="b793bcbfafe868118f2aa9150915a660433dd5c5ceff300717c3b53521bce3b9" Jul 15 15:09:15.338273 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:09:15.338257 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b793bcbfafe868118f2aa9150915a660433dd5c5ceff300717c3b53521bce3b9\": container with ID starting with b793bcbfafe868118f2aa9150915a660433dd5c5ceff300717c3b53521bce3b9 not found: ID does not exist" containerID="b793bcbfafe868118f2aa9150915a660433dd5c5ceff300717c3b53521bce3b9" Jul 15 15:09:15.338337 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:15.338281 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b793bcbfafe868118f2aa9150915a660433dd5c5ceff300717c3b53521bce3b9"} err="failed to get container status \"b793bcbfafe868118f2aa9150915a660433dd5c5ceff300717c3b53521bce3b9\": rpc error: code = NotFound desc = could not find container \"b793bcbfafe868118f2aa9150915a660433dd5c5ceff300717c3b53521bce3b9\": container with ID starting with b793bcbfafe868118f2aa9150915a660433dd5c5ceff300717c3b53521bce3b9 not found: ID does not exist" Jul 15 15:09:15.338337 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:15.338296 2565 scope.go:117] "RemoveContainer" containerID="71f4ce7a4f02cc996b4d08ffed566dcafd0bfc086278108677b8d13f1eadfe63" Jul 15 15:09:15.338501 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:09:15.338482 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71f4ce7a4f02cc996b4d08ffed566dcafd0bfc086278108677b8d13f1eadfe63\": container with ID starting with 71f4ce7a4f02cc996b4d08ffed566dcafd0bfc086278108677b8d13f1eadfe63 not found: ID does not exist" containerID="71f4ce7a4f02cc996b4d08ffed566dcafd0bfc086278108677b8d13f1eadfe63" Jul 15 15:09:15.338545 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:15.338508 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71f4ce7a4f02cc996b4d08ffed566dcafd0bfc086278108677b8d13f1eadfe63"} err="failed to get container status \"71f4ce7a4f02cc996b4d08ffed566dcafd0bfc086278108677b8d13f1eadfe63\": rpc error: code = NotFound desc = could not find container \"71f4ce7a4f02cc996b4d08ffed566dcafd0bfc086278108677b8d13f1eadfe63\": container with ID starting with 71f4ce7a4f02cc996b4d08ffed566dcafd0bfc086278108677b8d13f1eadfe63 not found: ID does not exist" Jul 15 15:09:15.341989 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:15.341969 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt"] Jul 15 15:09:15.345577 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:15.345546 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ef5b05d8-openshift-default-df6d9f967-g55gt"] Jul 15 15:09:16.676572 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:09:16.676536 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f4111ce-828e-43e8-9515-ec9ad762010e" path="/var/lib/kubelet/pods/3f4111ce-828e-43e8-9515-ec9ad762010e/volumes" Jul 15 15:10:04.225492 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.225456 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p"] Jul 15 15:10:04.226096 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.225838 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f4111ce-828e-43e8-9515-ec9ad762010e" containerName="istio-proxy" Jul 15 15:10:04.226096 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.225852 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f4111ce-828e-43e8-9515-ec9ad762010e" containerName="istio-proxy" Jul 15 15:10:04.226096 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.225871 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f4111ce-828e-43e8-9515-ec9ad762010e" containerName="istio-proxy" Jul 15 15:10:04.226096 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.225876 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f4111ce-828e-43e8-9515-ec9ad762010e" containerName="istio-proxy" Jul 15 15:10:04.226096 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.225926 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f4111ce-828e-43e8-9515-ec9ad762010e" containerName="istio-proxy" Jul 15 15:10:04.226096 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.225934 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f4111ce-828e-43e8-9515-ec9ad762010e" containerName="istio-proxy" Jul 15 15:10:04.228858 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.228838 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.231280 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.231257 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-73bd17-openshift-default-dockercfg-n722r\"" Jul 15 15:10:04.242188 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.242159 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p"] Jul 15 15:10:04.275184 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.275148 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-envoy\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.275184 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.275191 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-podinfo\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.275476 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.275260 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-credential-socket\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.275476 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.275293 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-workload-certs\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.275476 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.275363 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istiod-ca-cert\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.275476 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.275399 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrxnt\" (UniqueName: \"kubernetes.io/projected/92b8a42d-d9e2-41a1-a48b-35bf67e504be-kube-api-access-nrxnt\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.275476 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.275418 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-data\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.275754 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.275481 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-workload-socket\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.275754 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.275497 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-token\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.376131 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.376095 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-credential-socket\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.376131 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.376135 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-workload-certs\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.376476 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.376171 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istiod-ca-cert\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.376476 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.376196 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrxnt\" (UniqueName: \"kubernetes.io/projected/92b8a42d-d9e2-41a1-a48b-35bf67e504be-kube-api-access-nrxnt\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.376476 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.376225 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-data\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.376476 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.376296 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-workload-socket\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.376476 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.376320 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-token\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.376476 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.376354 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-envoy\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.376476 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.376455 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-podinfo\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.376788 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.376588 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-workload-certs\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.376788 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.376639 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-credential-socket\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.376943 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.376921 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-data\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.376996 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.376962 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-workload-socket\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.377222 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.377202 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istiod-ca-cert\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.379081 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.379058 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-envoy\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.379203 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.379089 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-podinfo\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.384228 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.384203 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrxnt\" (UniqueName: \"kubernetes.io/projected/92b8a42d-d9e2-41a1-a48b-35bf67e504be-kube-api-access-nrxnt\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.384448 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.384427 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-token\") pod \"e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.541522 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.541421 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:04.682164 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.682142 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p"] Jul 15 15:10:04.684500 ip-10-0-136-155 kubenswrapper[2565]: W0715 15:10:04.684476 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b8a42d_d9e2_41a1_a48b_35bf67e504be.slice/crio-ba3d7b036afa16192dd5c2758f7e7f19c87fc2fd68a34fa6db726ba45093906c WatchSource:0}: Error finding container ba3d7b036afa16192dd5c2758f7e7f19c87fc2fd68a34fa6db726ba45093906c: Status 404 returned error can't find the container with id ba3d7b036afa16192dd5c2758f7e7f19c87fc2fd68a34fa6db726ba45093906c Jul 15 15:10:04.686957 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.686925 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:10:04.687066 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.687006 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:10:04.687066 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:04.687054 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:10:05.529685 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:05.529648 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" event={"ID":"92b8a42d-d9e2-41a1-a48b-35bf67e504be","Type":"ContainerStarted","Data":"c43558f88eedb09e99028f82233825be41af8ecbb80d1eda2e73966c4b274c45"} Jul 15 15:10:05.530113 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:05.529708 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" event={"ID":"92b8a42d-d9e2-41a1-a48b-35bf67e504be","Type":"ContainerStarted","Data":"ba3d7b036afa16192dd5c2758f7e7f19c87fc2fd68a34fa6db726ba45093906c"} Jul 15 15:10:05.542122 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:05.542094 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:05.547340 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:05.547311 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:05.555310 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:05.555261 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" podStartSLOduration=1.555240849 podStartE2EDuration="1.555240849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:10:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:10:05.553239753 +0000 UTC m=+2365.426174313" watchObservedRunningTime="2026-07-15 15:10:05.555240849 +0000 UTC m=+2365.428175408" Jul 15 15:10:06.533868 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:06.533836 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:06.534934 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:06.534913 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:12.555278 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.555245 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws"] Jul 15 15:10:12.559001 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.558980 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.562160 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.562138 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-6bbf18-openshift-default-dockercfg-b8p55\"" Jul 15 15:10:12.571631 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.571609 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws"] Jul 15 15:10:12.652063 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.652015 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-workload-socket\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.652260 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.652068 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-data\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.652260 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.652145 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-envoy\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.652260 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.652236 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-credential-socket\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.652431 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.652262 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-workload-certs\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.652431 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.652289 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-podinfo\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.652431 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.652324 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcfpm\" (UniqueName: \"kubernetes.io/projected/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-kube-api-access-gcfpm\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.652431 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.652378 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istiod-ca-cert\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.652431 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.652409 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-token\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.753525 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.753488 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-data\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.753525 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.753530 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-envoy\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.753784 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.753586 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-credential-socket\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.753784 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.753602 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-workload-certs\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.753784 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.753621 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-podinfo\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.753784 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.753638 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcfpm\" (UniqueName: \"kubernetes.io/projected/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-kube-api-access-gcfpm\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.753784 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.753678 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istiod-ca-cert\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.753784 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.753712 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-token\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.753784 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.753781 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-workload-socket\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.754156 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.753965 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-data\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.754156 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.754007 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-credential-socket\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.754292 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.754272 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-workload-socket\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.754384 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.754366 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-workload-certs\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.754502 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.754479 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istiod-ca-cert\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.756105 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.756088 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-envoy\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.756248 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.756231 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-podinfo\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.767387 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.767361 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-token\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.767576 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.767555 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcfpm\" (UniqueName: \"kubernetes.io/projected/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-kube-api-access-gcfpm\") pod \"e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:12.869696 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:12.869606 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:13.009160 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:13.009123 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws"] Jul 15 15:10:13.012489 ip-10-0-136-155 kubenswrapper[2565]: W0715 15:10:13.012458 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8bd5c13_a1ff_40ac_b971_6ddb96972fa7.slice/crio-de5b4985d1efaf5efb1d0bff52601c8be5e146191c940c408cc2f7a79bf67b5f WatchSource:0}: Error finding container de5b4985d1efaf5efb1d0bff52601c8be5e146191c940c408cc2f7a79bf67b5f: Status 404 returned error can't find the container with id de5b4985d1efaf5efb1d0bff52601c8be5e146191c940c408cc2f7a79bf67b5f Jul 15 15:10:13.014588 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:13.014557 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:10:13.014666 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:13.014626 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:10:13.014666 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:13.014653 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:10:13.566081 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:13.566038 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" event={"ID":"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7","Type":"ContainerStarted","Data":"d6414f24167c1f09c2ba7409655d20e63743f7692a2b8c5bbd093b16913acdab"} Jul 15 15:10:13.566564 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:13.566130 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" event={"ID":"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7","Type":"ContainerStarted","Data":"de5b4985d1efaf5efb1d0bff52601c8be5e146191c940c408cc2f7a79bf67b5f"} Jul 15 15:10:13.586355 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:13.586291 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" podStartSLOduration=1.5862742440000002 podStartE2EDuration="1.586274244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:10:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:10:13.585726112 +0000 UTC m=+2373.458660672" watchObservedRunningTime="2026-07-15 15:10:13.586274244 +0000 UTC m=+2373.459208804" Jul 15 15:10:13.870443 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:13.870345 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:14.875123 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:14.875089 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:15.574308 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:15.574275 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:15.575164 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:15.575142 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:22.574980 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:22.574940 2565 patch_prober.go:28] interesting pod/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 15:10:22.575369 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:22.575032 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" podUID="92b8a42d-d9e2-41a1-a48b-35bf67e504be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 15:10:24.618700 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:24.618662 2565 generic.go:356] "Generic (PLEG): container finished" podID="92b8a42d-d9e2-41a1-a48b-35bf67e504be" containerID="c43558f88eedb09e99028f82233825be41af8ecbb80d1eda2e73966c4b274c45" exitCode=0 Jul 15 15:10:24.619131 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:24.618736 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" event={"ID":"92b8a42d-d9e2-41a1-a48b-35bf67e504be","Type":"ContainerDied","Data":"c43558f88eedb09e99028f82233825be41af8ecbb80d1eda2e73966c4b274c45"} Jul 15 15:10:24.619185 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:24.619172 2565 scope.go:117] "RemoveContainer" containerID="c43558f88eedb09e99028f82233825be41af8ecbb80d1eda2e73966c4b274c45" Jul 15 15:10:24.620239 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:24.620210 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:10:24.620305 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:24.620278 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:10:24.620342 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:24.620309 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:10:25.625504 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:25.625472 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" event={"ID":"92b8a42d-d9e2-41a1-a48b-35bf67e504be","Type":"ContainerStarted","Data":"66686d8a87c6a808c503501f559f5a1478cb051cf1370aa8eac9249f8ac940ab"} Jul 15 15:10:26.541953 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:26.541909 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:26.542530 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:26.542496 2565 patch_prober.go:28] interesting pod/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 15 15:10:26.542659 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:26.542572 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" podUID="92b8a42d-d9e2-41a1-a48b-35bf67e504be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 15 15:10:27.542748 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:27.542222 2565 patch_prober.go:28] interesting pod/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 15 15:10:27.542748 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:27.542299 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" podUID="92b8a42d-d9e2-41a1-a48b-35bf67e504be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 15 15:10:28.542942 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:28.542436 2565 patch_prober.go:28] interesting pod/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 15 15:10:28.542942 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:28.542524 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" podUID="92b8a42d-d9e2-41a1-a48b-35bf67e504be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 15 15:10:29.542674 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:29.542633 2565 patch_prober.go:28] interesting pod/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 15 15:10:29.542906 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:29.542713 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" podUID="92b8a42d-d9e2-41a1-a48b-35bf67e504be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 15 15:10:30.545656 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:30.545620 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:30.546053 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:30.545895 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:30.546632 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:30.546616 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:10:30.679223 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:30.677616 2565 patch_prober.go:28] interesting pod/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": read tcp 10.133.0.2:60184->10.133.0.30:15021: read: connection reset by peer" start-of-body= Jul 15 15:10:30.679223 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:30.677698 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" podUID="d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": read tcp 10.133.0.2:60184->10.133.0.30:15021: read: connection reset by peer" Jul 15 15:10:31.656488 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:31.656448 2565 generic.go:356] "Generic (PLEG): container finished" podID="d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" containerID="d6414f24167c1f09c2ba7409655d20e63743f7692a2b8c5bbd093b16913acdab" exitCode=0 Jul 15 15:10:31.656906 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:31.656523 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" event={"ID":"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7","Type":"ContainerDied","Data":"d6414f24167c1f09c2ba7409655d20e63743f7692a2b8c5bbd093b16913acdab"} Jul 15 15:10:31.657112 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:31.657097 2565 scope.go:117] "RemoveContainer" containerID="d6414f24167c1f09c2ba7409655d20e63743f7692a2b8c5bbd093b16913acdab" Jul 15 15:10:31.658119 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:31.658095 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:10:31.658178 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:31.658161 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:10:31.658217 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:31.658190 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:10:32.665231 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:32.665198 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" event={"ID":"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7","Type":"ContainerStarted","Data":"1785b6cdbc4933a5d90429138f8defc95cb4efe3263f973623a577d215018588"} Jul 15 15:10:32.870731 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:32.870691 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:32.871006 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:32.870983 2565 patch_prober.go:28] interesting pod/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 15 15:10:32.871060 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:32.871037 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" podUID="d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 15 15:10:33.871012 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:33.870977 2565 patch_prober.go:28] interesting pod/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 15 15:10:33.871415 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:33.871035 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" podUID="d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 15 15:10:34.870982 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:34.870948 2565 patch_prober.go:28] interesting pod/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 15 15:10:34.871170 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:34.871005 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" podUID="d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 15 15:10:35.870741 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:35.870697 2565 patch_prober.go:28] interesting pod/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 15 15:10:35.870975 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:35.870766 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" podUID="d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 15 15:10:36.873924 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:36.873891 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:36.874421 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:36.874296 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:10:36.874921 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:10:36.874902 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:11:45.380988 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:45.380950 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p"] Jul 15 15:11:45.381535 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:45.381246 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" podUID="92b8a42d-d9e2-41a1-a48b-35bf67e504be" containerName="istio-proxy" containerID="cri-o://66686d8a87c6a808c503501f559f5a1478cb051cf1370aa8eac9249f8ac940ab" gracePeriod=30 Jul 15 15:11:45.548443 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:45.548408 2565 patch_prober.go:28] interesting pod/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 15:11:45.548614 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:45.548465 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" podUID="92b8a42d-d9e2-41a1-a48b-35bf67e504be" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 15:11:50.632129 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.632104 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:11:50.799005 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.798911 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-envoy\") pod \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " Jul 15 15:11:50.799005 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.798947 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-token\") pod \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " Jul 15 15:11:50.799005 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.798973 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-data\") pod \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " Jul 15 15:11:50.799005 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.799005 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-workload-certs\") pod \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " Jul 15 15:11:50.799271 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.799107 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istiod-ca-cert\") pod \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " Jul 15 15:11:50.799271 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.799135 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-credential-socket\") pod \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " Jul 15 15:11:50.799271 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.799157 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrxnt\" (UniqueName: \"kubernetes.io/projected/92b8a42d-d9e2-41a1-a48b-35bf67e504be-kube-api-access-nrxnt\") pod \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " Jul 15 15:11:50.799271 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.799204 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-podinfo\") pod \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " Jul 15 15:11:50.799441 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.799282 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-workload-socket\") pod \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\" (UID: \"92b8a42d-d9e2-41a1-a48b-35bf67e504be\") " Jul 15 15:11:50.799516 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.799480 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "92b8a42d-d9e2-41a1-a48b-35bf67e504be" (UID: "92b8a42d-d9e2-41a1-a48b-35bf67e504be"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:11:50.799693 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.799628 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-credential-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:11:50.799792 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.799700 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "92b8a42d-d9e2-41a1-a48b-35bf67e504be" (UID: "92b8a42d-d9e2-41a1-a48b-35bf67e504be"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:11:50.799792 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.799715 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "92b8a42d-d9e2-41a1-a48b-35bf67e504be" (UID: "92b8a42d-d9e2-41a1-a48b-35bf67e504be"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:11:50.799993 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.799973 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-data" (OuterVolumeSpecName: "istio-data") pod "92b8a42d-d9e2-41a1-a48b-35bf67e504be" (UID: "92b8a42d-d9e2-41a1-a48b-35bf67e504be"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:11:50.800097 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.800073 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "92b8a42d-d9e2-41a1-a48b-35bf67e504be" (UID: "92b8a42d-d9e2-41a1-a48b-35bf67e504be"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:11:50.801259 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.801232 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-token" (OuterVolumeSpecName: "istio-token") pod "92b8a42d-d9e2-41a1-a48b-35bf67e504be" (UID: "92b8a42d-d9e2-41a1-a48b-35bf67e504be"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:11:50.801451 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.801429 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92b8a42d-d9e2-41a1-a48b-35bf67e504be-kube-api-access-nrxnt" (OuterVolumeSpecName: "kube-api-access-nrxnt") pod "92b8a42d-d9e2-41a1-a48b-35bf67e504be" (UID: "92b8a42d-d9e2-41a1-a48b-35bf67e504be"). InnerVolumeSpecName "kube-api-access-nrxnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:11:50.801523 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.801489 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "92b8a42d-d9e2-41a1-a48b-35bf67e504be" (UID: "92b8a42d-d9e2-41a1-a48b-35bf67e504be"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:11:50.801663 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.801638 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "92b8a42d-d9e2-41a1-a48b-35bf67e504be" (UID: "92b8a42d-d9e2-41a1-a48b-35bf67e504be"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 15:11:50.900662 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.900600 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istiod-ca-cert\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:11:50.900662 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.900657 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrxnt\" (UniqueName: \"kubernetes.io/projected/92b8a42d-d9e2-41a1-a48b-35bf67e504be-kube-api-access-nrxnt\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:11:50.900662 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.900673 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-podinfo\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:11:50.900931 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.900687 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-workload-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:11:50.900931 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.900703 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-envoy\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:11:50.900931 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.900716 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-token\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:11:50.900931 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.900727 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-istio-data\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:11:50.900931 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:50.900738 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92b8a42d-d9e2-41a1-a48b-35bf67e504be-workload-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:11:51.010231 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:51.010198 2565 generic.go:356] "Generic (PLEG): container finished" podID="92b8a42d-d9e2-41a1-a48b-35bf67e504be" containerID="66686d8a87c6a808c503501f559f5a1478cb051cf1370aa8eac9249f8ac940ab" exitCode=0 Jul 15 15:11:51.010402 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:51.010260 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" event={"ID":"92b8a42d-d9e2-41a1-a48b-35bf67e504be","Type":"ContainerDied","Data":"66686d8a87c6a808c503501f559f5a1478cb051cf1370aa8eac9249f8ac940ab"} Jul 15 15:11:51.010402 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:51.010275 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" Jul 15 15:11:51.010402 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:51.010333 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p" event={"ID":"92b8a42d-d9e2-41a1-a48b-35bf67e504be","Type":"ContainerDied","Data":"ba3d7b036afa16192dd5c2758f7e7f19c87fc2fd68a34fa6db726ba45093906c"} Jul 15 15:11:51.010402 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:51.010354 2565 scope.go:117] "RemoveContainer" containerID="66686d8a87c6a808c503501f559f5a1478cb051cf1370aa8eac9249f8ac940ab" Jul 15 15:11:51.019538 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:51.019519 2565 scope.go:117] "RemoveContainer" containerID="c43558f88eedb09e99028f82233825be41af8ecbb80d1eda2e73966c4b274c45" Jul 15 15:11:51.027004 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:51.026984 2565 scope.go:117] "RemoveContainer" containerID="66686d8a87c6a808c503501f559f5a1478cb051cf1370aa8eac9249f8ac940ab" Jul 15 15:11:51.027243 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:11:51.027222 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66686d8a87c6a808c503501f559f5a1478cb051cf1370aa8eac9249f8ac940ab\": container with ID starting with 66686d8a87c6a808c503501f559f5a1478cb051cf1370aa8eac9249f8ac940ab not found: ID does not exist" containerID="66686d8a87c6a808c503501f559f5a1478cb051cf1370aa8eac9249f8ac940ab" Jul 15 15:11:51.027309 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:51.027251 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66686d8a87c6a808c503501f559f5a1478cb051cf1370aa8eac9249f8ac940ab"} err="failed to get container status \"66686d8a87c6a808c503501f559f5a1478cb051cf1370aa8eac9249f8ac940ab\": rpc error: code = NotFound desc = could not find container \"66686d8a87c6a808c503501f559f5a1478cb051cf1370aa8eac9249f8ac940ab\": container with ID starting with 66686d8a87c6a808c503501f559f5a1478cb051cf1370aa8eac9249f8ac940ab not found: ID does not exist" Jul 15 15:11:51.027309 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:51.027274 2565 scope.go:117] "RemoveContainer" containerID="c43558f88eedb09e99028f82233825be41af8ecbb80d1eda2e73966c4b274c45" Jul 15 15:11:51.027511 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:11:51.027493 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c43558f88eedb09e99028f82233825be41af8ecbb80d1eda2e73966c4b274c45\": container with ID starting with c43558f88eedb09e99028f82233825be41af8ecbb80d1eda2e73966c4b274c45 not found: ID does not exist" containerID="c43558f88eedb09e99028f82233825be41af8ecbb80d1eda2e73966c4b274c45" Jul 15 15:11:51.027550 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:51.027519 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c43558f88eedb09e99028f82233825be41af8ecbb80d1eda2e73966c4b274c45"} err="failed to get container status \"c43558f88eedb09e99028f82233825be41af8ecbb80d1eda2e73966c4b274c45\": rpc error: code = NotFound desc = could not find container \"c43558f88eedb09e99028f82233825be41af8ecbb80d1eda2e73966c4b274c45\": container with ID starting with c43558f88eedb09e99028f82233825be41af8ecbb80d1eda2e73966c4b274c45 not found: ID does not exist" Jul 15 15:11:51.031764 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:51.031743 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p"] Jul 15 15:11:51.036252 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:51.036231 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-73bd17-openshift-default-684b4c4d9-lc25p"] Jul 15 15:11:52.676468 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:11:52.676427 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92b8a42d-d9e2-41a1-a48b-35bf67e504be" path="/var/lib/kubelet/pods/92b8a42d-d9e2-41a1-a48b-35bf67e504be/volumes" Jul 15 15:12:11.537235 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:11.537195 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws"] Jul 15 15:12:11.537719 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:11.537403 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" podUID="d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" containerName="istio-proxy" containerID="cri-o://1785b6cdbc4933a5d90429138f8defc95cb4efe3263f973623a577d215018588" gracePeriod=30 Jul 15 15:12:12.424554 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.424521 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj"] Jul 15 15:12:12.424853 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.424839 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92b8a42d-d9e2-41a1-a48b-35bf67e504be" containerName="istio-proxy" Jul 15 15:12:12.424908 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.424854 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="92b8a42d-d9e2-41a1-a48b-35bf67e504be" containerName="istio-proxy" Jul 15 15:12:12.424908 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.424869 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92b8a42d-d9e2-41a1-a48b-35bf67e504be" containerName="istio-proxy" Jul 15 15:12:12.424908 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.424875 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="92b8a42d-d9e2-41a1-a48b-35bf67e504be" containerName="istio-proxy" Jul 15 15:12:12.425011 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.424934 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="92b8a42d-d9e2-41a1-a48b-35bf67e504be" containerName="istio-proxy" Jul 15 15:12:12.427958 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.427937 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.430228 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.430203 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-7dbf7a-openshift-default-dockercfg-qdphz\"" Jul 15 15:12:12.441352 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.441323 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj"] Jul 15 15:12:12.493357 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.493317 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/791ea354-74db-463c-a703-4ab770efc49a-istio-podinfo\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.493357 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.493362 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-istio-data\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.493565 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.493399 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-istio-envoy\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.493565 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.493451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-workload-socket\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.493565 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.493479 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-credential-socket\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.493565 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.493500 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/791ea354-74db-463c-a703-4ab770efc49a-istio-token\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.493565 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.493518 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/791ea354-74db-463c-a703-4ab770efc49a-istiod-ca-cert\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.493742 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.493613 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-workload-certs\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.493742 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.493658 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm9dg\" (UniqueName: \"kubernetes.io/projected/791ea354-74db-463c-a703-4ab770efc49a-kube-api-access-wm9dg\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.594921 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.594884 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-istio-data\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.595430 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.594945 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-istio-envoy\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.595430 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.594985 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-workload-socket\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.595430 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.595008 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-credential-socket\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.595430 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.595037 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/791ea354-74db-463c-a703-4ab770efc49a-istio-token\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.595430 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.595064 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/791ea354-74db-463c-a703-4ab770efc49a-istiod-ca-cert\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.595430 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.595128 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-workload-certs\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.595430 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.595169 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm9dg\" (UniqueName: \"kubernetes.io/projected/791ea354-74db-463c-a703-4ab770efc49a-kube-api-access-wm9dg\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.595430 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.595235 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/791ea354-74db-463c-a703-4ab770efc49a-istio-podinfo\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.595430 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.595332 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-istio-data\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.595882 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.595463 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-workload-socket\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.595882 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.595553 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-workload-certs\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.595882 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.595750 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-credential-socket\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.595989 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.595825 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/791ea354-74db-463c-a703-4ab770efc49a-istiod-ca-cert\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.602944 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.601325 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/791ea354-74db-463c-a703-4ab770efc49a-istio-podinfo\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.602944 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.601956 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-istio-envoy\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.604218 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.604197 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm9dg\" (UniqueName: \"kubernetes.io/projected/791ea354-74db-463c-a703-4ab770efc49a-kube-api-access-wm9dg\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.604540 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.604519 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/791ea354-74db-463c-a703-4ab770efc49a-istio-token\") pod \"e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.738653 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.738561 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:12.872040 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.871983 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj"] Jul 15 15:12:12.879666 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.879630 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:12:12.879784 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.879711 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:12:12.879784 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:12.879756 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:12:13.105658 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:13.105554 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" event={"ID":"791ea354-74db-463c-a703-4ab770efc49a","Type":"ContainerStarted","Data":"3198f44918b444027fa5e3b7b408a2c53ecbe24bddcc96b3cde97e716df45c87"} Jul 15 15:12:13.105658 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:13.105613 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" event={"ID":"791ea354-74db-463c-a703-4ab770efc49a","Type":"ContainerStarted","Data":"cadc0cfbbc7e0c88937ccb6391871cc740532ede4eab07b879ab0c3d7938aef3"} Jul 15 15:12:13.127621 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:13.127566 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" podStartSLOduration=1.127548504 podStartE2EDuration="1.127548504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:12:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:12:13.125980188 +0000 UTC m=+2492.998914760" watchObservedRunningTime="2026-07-15 15:12:13.127548504 +0000 UTC m=+2493.000483063" Jul 15 15:12:13.739755 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:13.739721 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:13.744571 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:13.744547 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:14.110568 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:14.110479 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:14.111495 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:14.111477 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:16.798193 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.798133 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:12:16.936218 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.936115 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-workload-socket\") pod \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " Jul 15 15:12:16.936393 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.936267 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcfpm\" (UniqueName: \"kubernetes.io/projected/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-kube-api-access-gcfpm\") pod \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " Jul 15 15:12:16.936393 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.936332 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-workload-certs\") pod \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " Jul 15 15:12:16.936393 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.936341 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" (UID: "d8bd5c13-a1ff-40ac-b971-6ddb96972fa7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:12:16.936503 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.936391 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istiod-ca-cert\") pod \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " Jul 15 15:12:16.936503 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.936425 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-podinfo\") pod \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " Jul 15 15:12:16.936503 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.936473 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-token\") pod \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " Jul 15 15:12:16.936647 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.936506 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-data\") pod \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " Jul 15 15:12:16.936647 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.936561 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-envoy\") pod \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " Jul 15 15:12:16.936647 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.936589 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-credential-socket\") pod \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\" (UID: \"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7\") " Jul 15 15:12:16.936647 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.936602 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" (UID: "d8bd5c13-a1ff-40ac-b971-6ddb96972fa7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:12:16.936894 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.936863 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" (UID: "d8bd5c13-a1ff-40ac-b971-6ddb96972fa7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:12:16.936970 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.936949 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istiod-ca-cert\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:12:16.937023 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.936967 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-workload-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:12:16.937023 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.936983 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-workload-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:12:16.937126 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.937018 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" (UID: "d8bd5c13-a1ff-40ac-b971-6ddb96972fa7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:12:16.937395 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.937368 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-data" (OuterVolumeSpecName: "istio-data") pod "d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" (UID: "d8bd5c13-a1ff-40ac-b971-6ddb96972fa7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:12:16.938593 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.938559 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-kube-api-access-gcfpm" (OuterVolumeSpecName: "kube-api-access-gcfpm") pod "d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" (UID: "d8bd5c13-a1ff-40ac-b971-6ddb96972fa7"). InnerVolumeSpecName "kube-api-access-gcfpm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:12:16.938714 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.938701 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-token" (OuterVolumeSpecName: "istio-token") pod "d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" (UID: "d8bd5c13-a1ff-40ac-b971-6ddb96972fa7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:12:16.938772 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.938750 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" (UID: "d8bd5c13-a1ff-40ac-b971-6ddb96972fa7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 15:12:16.938868 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:16.938796 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" (UID: "d8bd5c13-a1ff-40ac-b971-6ddb96972fa7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:12:17.037885 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:17.037848 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-podinfo\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:12:17.037885 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:17.037878 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-token\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:12:17.037885 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:17.037890 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-data\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:12:17.038129 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:17.037901 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-istio-envoy\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:12:17.038129 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:17.037912 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-credential-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:12:17.038129 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:17.037923 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcfpm\" (UniqueName: \"kubernetes.io/projected/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7-kube-api-access-gcfpm\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:12:17.123658 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:17.123562 2565 generic.go:356] "Generic (PLEG): container finished" podID="d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" containerID="1785b6cdbc4933a5d90429138f8defc95cb4efe3263f973623a577d215018588" exitCode=0 Jul 15 15:12:17.123658 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:17.123622 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" Jul 15 15:12:17.123873 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:17.123650 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" event={"ID":"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7","Type":"ContainerDied","Data":"1785b6cdbc4933a5d90429138f8defc95cb4efe3263f973623a577d215018588"} Jul 15 15:12:17.123873 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:17.123707 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws" event={"ID":"d8bd5c13-a1ff-40ac-b971-6ddb96972fa7","Type":"ContainerDied","Data":"de5b4985d1efaf5efb1d0bff52601c8be5e146191c940c408cc2f7a79bf67b5f"} Jul 15 15:12:17.123873 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:17.123730 2565 scope.go:117] "RemoveContainer" containerID="1785b6cdbc4933a5d90429138f8defc95cb4efe3263f973623a577d215018588" Jul 15 15:12:17.133020 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:17.133000 2565 scope.go:117] "RemoveContainer" containerID="d6414f24167c1f09c2ba7409655d20e63743f7692a2b8c5bbd093b16913acdab" Jul 15 15:12:17.141107 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:17.141080 2565 scope.go:117] "RemoveContainer" containerID="1785b6cdbc4933a5d90429138f8defc95cb4efe3263f973623a577d215018588" Jul 15 15:12:17.141346 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:12:17.141327 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1785b6cdbc4933a5d90429138f8defc95cb4efe3263f973623a577d215018588\": container with ID starting with 1785b6cdbc4933a5d90429138f8defc95cb4efe3263f973623a577d215018588 not found: ID does not exist" containerID="1785b6cdbc4933a5d90429138f8defc95cb4efe3263f973623a577d215018588" Jul 15 15:12:17.141399 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:17.141358 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1785b6cdbc4933a5d90429138f8defc95cb4efe3263f973623a577d215018588"} err="failed to get container status \"1785b6cdbc4933a5d90429138f8defc95cb4efe3263f973623a577d215018588\": rpc error: code = NotFound desc = could not find container \"1785b6cdbc4933a5d90429138f8defc95cb4efe3263f973623a577d215018588\": container with ID starting with 1785b6cdbc4933a5d90429138f8defc95cb4efe3263f973623a577d215018588 not found: ID does not exist" Jul 15 15:12:17.141399 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:17.141375 2565 scope.go:117] "RemoveContainer" containerID="d6414f24167c1f09c2ba7409655d20e63743f7692a2b8c5bbd093b16913acdab" Jul 15 15:12:17.141644 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:12:17.141624 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6414f24167c1f09c2ba7409655d20e63743f7692a2b8c5bbd093b16913acdab\": container with ID starting with d6414f24167c1f09c2ba7409655d20e63743f7692a2b8c5bbd093b16913acdab not found: ID does not exist" containerID="d6414f24167c1f09c2ba7409655d20e63743f7692a2b8c5bbd093b16913acdab" Jul 15 15:12:17.141705 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:17.141654 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6414f24167c1f09c2ba7409655d20e63743f7692a2b8c5bbd093b16913acdab"} err="failed to get container status \"d6414f24167c1f09c2ba7409655d20e63743f7692a2b8c5bbd093b16913acdab\": rpc error: code = NotFound desc = could not find container \"d6414f24167c1f09c2ba7409655d20e63743f7692a2b8c5bbd093b16913acdab\": container with ID starting with d6414f24167c1f09c2ba7409655d20e63743f7692a2b8c5bbd093b16913acdab not found: ID does not exist" Jul 15 15:12:17.146515 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:17.146489 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws"] Jul 15 15:12:17.155311 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:17.155287 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-6bbf18-openshift-default-6dfdd8d7b9-xwhws"] Jul 15 15:12:18.676690 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:18.676658 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" path="/var/lib/kubelet/pods/d8bd5c13-a1ff-40ac-b971-6ddb96972fa7/volumes" Jul 15 15:12:20.263901 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.263864 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf"] Jul 15 15:12:20.264359 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.264341 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" containerName="istio-proxy" Jul 15 15:12:20.264436 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.264361 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" containerName="istio-proxy" Jul 15 15:12:20.264436 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.264382 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" containerName="istio-proxy" Jul 15 15:12:20.264436 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.264391 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" containerName="istio-proxy" Jul 15 15:12:20.264540 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.264468 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" containerName="istio-proxy" Jul 15 15:12:20.264540 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.264481 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8bd5c13-a1ff-40ac-b971-6ddb96972fa7" containerName="istio-proxy" Jul 15 15:12:20.264540 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.264495 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="92b8a42d-d9e2-41a1-a48b-35bf67e504be" containerName="istio-proxy" Jul 15 15:12:20.269294 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.269268 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.271762 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.271743 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-0614af-openshift-default-dockercfg-d8wqg\"" Jul 15 15:12:20.280346 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.280321 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf"] Jul 15 15:12:20.369546 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.369513 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-envoy\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.369728 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.369560 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-data\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.369728 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.369677 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-workload-socket\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.369728 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.369722 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-podinfo\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.369872 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.369826 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-credential-socket\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.369907 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.369890 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w44zw\" (UniqueName: \"kubernetes.io/projected/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-kube-api-access-w44zw\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.369948 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.369927 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-workload-certs\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.369997 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.369952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-token\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.369997 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.369976 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istiod-ca-cert\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.471156 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.471114 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-workload-certs\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.471156 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.471156 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-token\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.471431 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.471172 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istiod-ca-cert\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.471431 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.471230 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-envoy\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.471431 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.471259 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-data\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.471431 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.471296 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-workload-socket\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.471431 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.471324 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-podinfo\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.471431 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.471367 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-credential-socket\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.471431 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.471411 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w44zw\" (UniqueName: \"kubernetes.io/projected/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-kube-api-access-w44zw\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.471750 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.471597 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-workload-certs\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.471791 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.471750 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-data\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.471862 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.471825 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-workload-socket\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.472015 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.471992 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istiod-ca-cert\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.472015 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.471999 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-credential-socket\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.473769 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.473750 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-envoy\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.474008 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.473990 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-podinfo\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.479876 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.479852 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-token\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.479962 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.479927 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w44zw\" (UniqueName: \"kubernetes.io/projected/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-kube-api-access-w44zw\") pod \"e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.580284 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.580194 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:20.726655 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.726631 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf"] Jul 15 15:12:20.728996 ip-10-0-136-155 kubenswrapper[2565]: W0715 15:12:20.728964 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63a1e4b6_8d7d_4890_aa71_78d9d1be897f.slice/crio-0a2c6bcc7af1a57927cfb583e98a5c590ea37299571df4e3d0bcf194b8ac882b WatchSource:0}: Error finding container 0a2c6bcc7af1a57927cfb583e98a5c590ea37299571df4e3d0bcf194b8ac882b: Status 404 returned error can't find the container with id 0a2c6bcc7af1a57927cfb583e98a5c590ea37299571df4e3d0bcf194b8ac882b Jul 15 15:12:20.731229 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.731190 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:12:20.731304 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.731277 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:12:20.731356 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:20.731320 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:12:21.144072 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:21.144040 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" event={"ID":"63a1e4b6-8d7d-4890-aa71-78d9d1be897f","Type":"ContainerStarted","Data":"9a2cf8e1f411692000f7a249b1ad4824dd2f950ed67dbef8abc3373f20096e49"} Jul 15 15:12:21.144253 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:21.144095 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" event={"ID":"63a1e4b6-8d7d-4890-aa71-78d9d1be897f","Type":"ContainerStarted","Data":"0a2c6bcc7af1a57927cfb583e98a5c590ea37299571df4e3d0bcf194b8ac882b"} Jul 15 15:12:21.166605 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:21.166556 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" podStartSLOduration=1.166539646 podStartE2EDuration="1.166539646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:12:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:12:21.165256474 +0000 UTC m=+2501.038191036" watchObservedRunningTime="2026-07-15 15:12:21.166539646 +0000 UTC m=+2501.039474206" Jul 15 15:12:21.580760 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:21.580657 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:21.585912 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:21.585886 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:22.161133 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:22.161101 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:22.162513 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:22.162488 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:29.112005 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:29.111967 2565 patch_prober.go:28] interesting pod/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 15 15:12:29.112429 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:29.112021 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" podUID="791ea354-74db-463c-a703-4ab770efc49a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 15 15:12:29.195787 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:29.195752 2565 generic.go:356] "Generic (PLEG): container finished" podID="791ea354-74db-463c-a703-4ab770efc49a" containerID="3198f44918b444027fa5e3b7b408a2c53ecbe24bddcc96b3cde97e716df45c87" exitCode=0 Jul 15 15:12:29.195971 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:29.195836 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" event={"ID":"791ea354-74db-463c-a703-4ab770efc49a","Type":"ContainerDied","Data":"3198f44918b444027fa5e3b7b408a2c53ecbe24bddcc96b3cde97e716df45c87"} Jul 15 15:12:29.196246 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:29.196219 2565 scope.go:117] "RemoveContainer" containerID="3198f44918b444027fa5e3b7b408a2c53ecbe24bddcc96b3cde97e716df45c87" Jul 15 15:12:29.197446 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:29.197418 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:12:29.197510 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:29.197499 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:12:29.197546 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:29.197533 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:12:30.202080 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:30.202046 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" event={"ID":"791ea354-74db-463c-a703-4ab770efc49a","Type":"ContainerStarted","Data":"44056d6f9993062bfbf05e97da03c158b564e24a4569a41db209e86c09a49d45"} Jul 15 15:12:30.739441 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:30.739399 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:30.739668 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:30.739540 2565 patch_prober.go:28] interesting pod/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 15 15:12:30.739668 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:30.739588 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" podUID="791ea354-74db-463c-a703-4ab770efc49a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 15 15:12:31.749287 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:31.749236 2565 patch_prober.go:28] interesting pod/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 15 15:12:31.749790 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:31.749308 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" podUID="791ea354-74db-463c-a703-4ab770efc49a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 15 15:12:32.739682 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:32.739583 2565 patch_prober.go:28] interesting pod/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 15 15:12:32.739682 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:32.739654 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" podUID="791ea354-74db-463c-a703-4ab770efc49a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 15 15:12:33.740117 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:33.739655 2565 patch_prober.go:28] interesting pod/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 15 15:12:33.740117 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:33.739720 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" podUID="791ea354-74db-463c-a703-4ab770efc49a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 15 15:12:34.743551 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:34.743518 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:34.744017 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:34.743791 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:34.744661 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:34.744641 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:12:35.226158 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:35.226123 2565 generic.go:356] "Generic (PLEG): container finished" podID="63a1e4b6-8d7d-4890-aa71-78d9d1be897f" containerID="9a2cf8e1f411692000f7a249b1ad4824dd2f950ed67dbef8abc3373f20096e49" exitCode=0 Jul 15 15:12:35.226375 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:35.226195 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" event={"ID":"63a1e4b6-8d7d-4890-aa71-78d9d1be897f","Type":"ContainerDied","Data":"9a2cf8e1f411692000f7a249b1ad4824dd2f950ed67dbef8abc3373f20096e49"} Jul 15 15:12:35.226718 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:35.226702 2565 scope.go:117] "RemoveContainer" containerID="9a2cf8e1f411692000f7a249b1ad4824dd2f950ed67dbef8abc3373f20096e49" Jul 15 15:12:35.227774 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:35.227747 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:12:35.227865 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:35.227843 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:12:35.227905 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:35.227890 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:12:36.232118 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:36.232083 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" event={"ID":"63a1e4b6-8d7d-4890-aa71-78d9d1be897f","Type":"ContainerStarted","Data":"1e4e39854cd3c026627d533d6f906296c13be0d7f16f3ca168d1bfef01747232"} Jul 15 15:12:36.580508 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:36.580415 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:36.581446 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:36.581419 2565 patch_prober.go:28] interesting pod/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 15 15:12:36.581570 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:36.581469 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" podUID="63a1e4b6-8d7d-4890-aa71-78d9d1be897f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 15 15:12:37.161562 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:37.161514 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:37.581628 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:37.581509 2565 patch_prober.go:28] interesting pod/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 15 15:12:37.581628 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:37.581592 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" podUID="63a1e4b6-8d7d-4890-aa71-78d9d1be897f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 15 15:12:38.580909 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:38.580863 2565 patch_prober.go:28] interesting pod/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 15 15:12:38.581094 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:38.580923 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" podUID="63a1e4b6-8d7d-4890-aa71-78d9d1be897f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 15 15:12:39.581364 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:39.581320 2565 patch_prober.go:28] interesting pod/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 15 15:12:39.581785 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:39.581381 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" podUID="63a1e4b6-8d7d-4890-aa71-78d9d1be897f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 15 15:12:40.580721 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:40.580680 2565 patch_prober.go:28] interesting pod/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 15 15:12:40.580929 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:40.580742 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" podUID="63a1e4b6-8d7d-4890-aa71-78d9d1be897f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 15 15:12:41.584957 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:41.584926 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:12:41.585802 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:12:41.585784 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:13:01.374660 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:01.374625 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj"] Jul 15 15:13:01.375236 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:01.374869 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" podUID="791ea354-74db-463c-a703-4ab770efc49a" containerName="istio-proxy" containerID="cri-o://44056d6f9993062bfbf05e97da03c158b564e24a4569a41db209e86c09a49d45" gracePeriod=30 Jul 15 15:13:04.746199 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:04.746157 2565 patch_prober.go:28] interesting pod/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 15:13:04.746671 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:04.746222 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" podUID="791ea354-74db-463c-a703-4ab770efc49a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 15:13:06.629491 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.629468 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:13:06.734507 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.734461 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/791ea354-74db-463c-a703-4ab770efc49a-istiod-ca-cert\") pod \"791ea354-74db-463c-a703-4ab770efc49a\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " Jul 15 15:13:06.734693 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.734534 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/791ea354-74db-463c-a703-4ab770efc49a-istio-podinfo\") pod \"791ea354-74db-463c-a703-4ab770efc49a\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " Jul 15 15:13:06.734693 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.734567 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-istio-envoy\") pod \"791ea354-74db-463c-a703-4ab770efc49a\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " Jul 15 15:13:06.734693 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.734594 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-workload-certs\") pod \"791ea354-74db-463c-a703-4ab770efc49a\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " Jul 15 15:13:06.734693 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.734643 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-credential-socket\") pod \"791ea354-74db-463c-a703-4ab770efc49a\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " Jul 15 15:13:06.734693 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.734686 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-istio-data\") pod \"791ea354-74db-463c-a703-4ab770efc49a\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " Jul 15 15:13:06.734995 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.734709 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm9dg\" (UniqueName: \"kubernetes.io/projected/791ea354-74db-463c-a703-4ab770efc49a-kube-api-access-wm9dg\") pod \"791ea354-74db-463c-a703-4ab770efc49a\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " Jul 15 15:13:06.734995 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.734759 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/791ea354-74db-463c-a703-4ab770efc49a-istio-token\") pod \"791ea354-74db-463c-a703-4ab770efc49a\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " Jul 15 15:13:06.734995 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.734788 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-workload-socket\") pod \"791ea354-74db-463c-a703-4ab770efc49a\" (UID: \"791ea354-74db-463c-a703-4ab770efc49a\") " Jul 15 15:13:06.735708 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.735436 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/791ea354-74db-463c-a703-4ab770efc49a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "791ea354-74db-463c-a703-4ab770efc49a" (UID: "791ea354-74db-463c-a703-4ab770efc49a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:13:06.735708 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.735655 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "791ea354-74db-463c-a703-4ab770efc49a" (UID: "791ea354-74db-463c-a703-4ab770efc49a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:13:06.735898 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.735769 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "791ea354-74db-463c-a703-4ab770efc49a" (UID: "791ea354-74db-463c-a703-4ab770efc49a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:13:06.736292 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.736258 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-istio-data" (OuterVolumeSpecName: "istio-data") pod "791ea354-74db-463c-a703-4ab770efc49a" (UID: "791ea354-74db-463c-a703-4ab770efc49a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:13:06.736402 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.736332 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "791ea354-74db-463c-a703-4ab770efc49a" (UID: "791ea354-74db-463c-a703-4ab770efc49a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:13:06.737860 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.737139 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "791ea354-74db-463c-a703-4ab770efc49a" (UID: "791ea354-74db-463c-a703-4ab770efc49a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:13:06.739870 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.738103 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/791ea354-74db-463c-a703-4ab770efc49a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "791ea354-74db-463c-a703-4ab770efc49a" (UID: "791ea354-74db-463c-a703-4ab770efc49a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 15:13:06.739870 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.738414 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/791ea354-74db-463c-a703-4ab770efc49a-kube-api-access-wm9dg" (OuterVolumeSpecName: "kube-api-access-wm9dg") pod "791ea354-74db-463c-a703-4ab770efc49a" (UID: "791ea354-74db-463c-a703-4ab770efc49a"). InnerVolumeSpecName "kube-api-access-wm9dg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:13:06.742755 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.742729 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/791ea354-74db-463c-a703-4ab770efc49a-istio-token" (OuterVolumeSpecName: "istio-token") pod "791ea354-74db-463c-a703-4ab770efc49a" (UID: "791ea354-74db-463c-a703-4ab770efc49a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:13:06.836515 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.836473 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-credential-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:13:06.836515 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.836507 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-istio-data\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:13:06.836515 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.836521 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm9dg\" (UniqueName: \"kubernetes.io/projected/791ea354-74db-463c-a703-4ab770efc49a-kube-api-access-wm9dg\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:13:06.836770 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.836536 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/791ea354-74db-463c-a703-4ab770efc49a-istio-token\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:13:06.836770 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.836547 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-workload-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:13:06.836770 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.836558 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/791ea354-74db-463c-a703-4ab770efc49a-istiod-ca-cert\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:13:06.836770 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.836569 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/791ea354-74db-463c-a703-4ab770efc49a-istio-podinfo\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:13:06.836770 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.836579 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-istio-envoy\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:13:06.836770 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:06.836590 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/791ea354-74db-463c-a703-4ab770efc49a-workload-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:13:07.380859 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:07.380787 2565 generic.go:356] "Generic (PLEG): container finished" podID="791ea354-74db-463c-a703-4ab770efc49a" containerID="44056d6f9993062bfbf05e97da03c158b564e24a4569a41db209e86c09a49d45" exitCode=0 Jul 15 15:13:07.381044 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:07.380872 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" event={"ID":"791ea354-74db-463c-a703-4ab770efc49a","Type":"ContainerDied","Data":"44056d6f9993062bfbf05e97da03c158b564e24a4569a41db209e86c09a49d45"} Jul 15 15:13:07.381044 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:07.380956 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" event={"ID":"791ea354-74db-463c-a703-4ab770efc49a","Type":"ContainerDied","Data":"cadc0cfbbc7e0c88937ccb6391871cc740532ede4eab07b879ab0c3d7938aef3"} Jul 15 15:13:07.381044 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:07.380974 2565 scope.go:117] "RemoveContainer" containerID="44056d6f9993062bfbf05e97da03c158b564e24a4569a41db209e86c09a49d45" Jul 15 15:13:07.381205 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:07.380890 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj" Jul 15 15:13:07.390324 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:07.390307 2565 scope.go:117] "RemoveContainer" containerID="3198f44918b444027fa5e3b7b408a2c53ecbe24bddcc96b3cde97e716df45c87" Jul 15 15:13:07.397849 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:07.397836 2565 scope.go:117] "RemoveContainer" containerID="44056d6f9993062bfbf05e97da03c158b564e24a4569a41db209e86c09a49d45" Jul 15 15:13:07.398110 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:13:07.398092 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44056d6f9993062bfbf05e97da03c158b564e24a4569a41db209e86c09a49d45\": container with ID starting with 44056d6f9993062bfbf05e97da03c158b564e24a4569a41db209e86c09a49d45 not found: ID does not exist" containerID="44056d6f9993062bfbf05e97da03c158b564e24a4569a41db209e86c09a49d45" Jul 15 15:13:07.398163 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:07.398118 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44056d6f9993062bfbf05e97da03c158b564e24a4569a41db209e86c09a49d45"} err="failed to get container status \"44056d6f9993062bfbf05e97da03c158b564e24a4569a41db209e86c09a49d45\": rpc error: code = NotFound desc = could not find container \"44056d6f9993062bfbf05e97da03c158b564e24a4569a41db209e86c09a49d45\": container with ID starting with 44056d6f9993062bfbf05e97da03c158b564e24a4569a41db209e86c09a49d45 not found: ID does not exist" Jul 15 15:13:07.398163 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:07.398134 2565 scope.go:117] "RemoveContainer" containerID="3198f44918b444027fa5e3b7b408a2c53ecbe24bddcc96b3cde97e716df45c87" Jul 15 15:13:07.398386 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:13:07.398369 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3198f44918b444027fa5e3b7b408a2c53ecbe24bddcc96b3cde97e716df45c87\": container with ID starting with 3198f44918b444027fa5e3b7b408a2c53ecbe24bddcc96b3cde97e716df45c87 not found: ID does not exist" containerID="3198f44918b444027fa5e3b7b408a2c53ecbe24bddcc96b3cde97e716df45c87" Jul 15 15:13:07.398446 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:07.398396 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3198f44918b444027fa5e3b7b408a2c53ecbe24bddcc96b3cde97e716df45c87"} err="failed to get container status \"3198f44918b444027fa5e3b7b408a2c53ecbe24bddcc96b3cde97e716df45c87\": rpc error: code = NotFound desc = could not find container \"3198f44918b444027fa5e3b7b408a2c53ecbe24bddcc96b3cde97e716df45c87\": container with ID starting with 3198f44918b444027fa5e3b7b408a2c53ecbe24bddcc96b3cde97e716df45c87 not found: ID does not exist" Jul 15 15:13:07.403110 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:07.403089 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj"] Jul 15 15:13:07.407075 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:07.407052 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-7dbf7a-openshift-default-55f7bf7657-gnsjj"] Jul 15 15:13:08.676220 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:08.676186 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="791ea354-74db-463c-a703-4ab770efc49a" path="/var/lib/kubelet/pods/791ea354-74db-463c-a703-4ab770efc49a/volumes" Jul 15 15:13:27.568828 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:27.568766 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf"] Jul 15 15:13:27.569418 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:27.569072 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" podUID="63a1e4b6-8d7d-4890-aa71-78d9d1be897f" containerName="istio-proxy" containerID="cri-o://1e4e39854cd3c026627d533d6f906296c13be0d7f16f3ca168d1bfef01747232" gracePeriod=30 Jul 15 15:13:28.519525 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.519494 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs"] Jul 15 15:13:28.519833 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.519821 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="791ea354-74db-463c-a703-4ab770efc49a" containerName="istio-proxy" Jul 15 15:13:28.519884 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.519835 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="791ea354-74db-463c-a703-4ab770efc49a" containerName="istio-proxy" Jul 15 15:13:28.519920 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.519893 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="791ea354-74db-463c-a703-4ab770efc49a" containerName="istio-proxy" Jul 15 15:13:28.519920 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.519903 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="791ea354-74db-463c-a703-4ab770efc49a" containerName="istio-proxy" Jul 15 15:13:28.521670 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.521655 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.524070 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.524053 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-e7a94a-openshift-default-dockercfg-wmbh8\"" Jul 15 15:13:28.537927 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.537905 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs"] Jul 15 15:13:28.631626 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.631598 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-istio-data\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.632085 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.631641 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-workload-socket\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.632085 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.631674 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1526a72-82e3-4f02-a119-64300135b416-istio-podinfo\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.632085 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.631781 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-credential-socket\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.632085 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.631833 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-workload-certs\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.632085 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.631854 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-istio-envoy\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.632085 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.631879 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1526a72-82e3-4f02-a119-64300135b416-istiod-ca-cert\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.632085 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.631895 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg9p9\" (UniqueName: \"kubernetes.io/projected/e1526a72-82e3-4f02-a119-64300135b416-kube-api-access-wg9p9\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.632085 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.631980 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1526a72-82e3-4f02-a119-64300135b416-istio-token\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.733002 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.732968 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-istio-data\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.733182 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.733010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-workload-socket\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.733182 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.733038 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1526a72-82e3-4f02-a119-64300135b416-istio-podinfo\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.733182 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.733078 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-credential-socket\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.733182 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.733102 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-workload-certs\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.733182 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.733125 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-istio-envoy\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.733182 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.733160 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1526a72-82e3-4f02-a119-64300135b416-istiod-ca-cert\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.733182 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.733183 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg9p9\" (UniqueName: \"kubernetes.io/projected/e1526a72-82e3-4f02-a119-64300135b416-kube-api-access-wg9p9\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.733579 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.733246 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1526a72-82e3-4f02-a119-64300135b416-istio-token\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.733579 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.733468 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-workload-socket\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.733579 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.733543 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-credential-socket\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.733761 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.733597 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-workload-certs\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.733843 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.733795 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-istio-data\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.734028 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.734009 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1526a72-82e3-4f02-a119-64300135b416-istiod-ca-cert\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.735518 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.735498 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-istio-envoy\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.735612 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.735551 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1526a72-82e3-4f02-a119-64300135b416-istio-podinfo\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.740776 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.740747 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1526a72-82e3-4f02-a119-64300135b416-istio-token\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.740983 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.740966 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg9p9\" (UniqueName: \"kubernetes.io/projected/e1526a72-82e3-4f02-a119-64300135b416-kube-api-access-wg9p9\") pod \"e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.831599 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.831493 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:28.990383 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.990360 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs"] Jul 15 15:13:28.992255 ip-10-0-136-155 kubenswrapper[2565]: W0715 15:13:28.992233 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1526a72_82e3_4f02_a119_64300135b416.slice/crio-af9eaac209e7d2638b39c689694f3eac2498ababf4e5b93685fa3c2b32aa7558 WatchSource:0}: Error finding container af9eaac209e7d2638b39c689694f3eac2498ababf4e5b93685fa3c2b32aa7558: Status 404 returned error can't find the container with id af9eaac209e7d2638b39c689694f3eac2498ababf4e5b93685fa3c2b32aa7558 Jul 15 15:13:28.994920 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.994886 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:13:28.995003 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.994951 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:13:28.995003 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:28.994985 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:13:29.476297 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:29.476263 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" event={"ID":"e1526a72-82e3-4f02-a119-64300135b416","Type":"ContainerStarted","Data":"25f75d926f865fe28d703934d5185256609df3c52163654cb5ec00c26a5377e6"} Jul 15 15:13:29.476479 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:29.476318 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" event={"ID":"e1526a72-82e3-4f02-a119-64300135b416","Type":"ContainerStarted","Data":"af9eaac209e7d2638b39c689694f3eac2498ababf4e5b93685fa3c2b32aa7558"} Jul 15 15:13:29.497194 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:29.497147 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" podStartSLOduration=1.497131787 podStartE2EDuration="1.497131787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:13:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:13:29.495562598 +0000 UTC m=+2569.368497161" watchObservedRunningTime="2026-07-15 15:13:29.497131787 +0000 UTC m=+2569.370066354" Jul 15 15:13:29.832570 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:29.832483 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:30.839019 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:30.838979 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:31.486865 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:31.486826 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:31.487900 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:31.487880 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:32.827297 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.827276 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:13:32.870165 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.870075 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-podinfo\") pod \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " Jul 15 15:13:32.870165 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.870135 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-data\") pod \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " Jul 15 15:13:32.870165 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.870159 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-workload-certs\") pod \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " Jul 15 15:13:32.870522 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.870254 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-workload-socket\") pod \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " Jul 15 15:13:32.870522 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.870292 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-credential-socket\") pod \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " Jul 15 15:13:32.870522 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.870314 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-token\") pod \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " Jul 15 15:13:32.870522 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.870394 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w44zw\" (UniqueName: \"kubernetes.io/projected/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-kube-api-access-w44zw\") pod \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " Jul 15 15:13:32.870522 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.870408 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "63a1e4b6-8d7d-4890-aa71-78d9d1be897f" (UID: "63a1e4b6-8d7d-4890-aa71-78d9d1be897f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:13:32.870522 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.870439 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istiod-ca-cert\") pod \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " Jul 15 15:13:32.870522 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.870489 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-envoy\") pod \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\" (UID: \"63a1e4b6-8d7d-4890-aa71-78d9d1be897f\") " Jul 15 15:13:32.870923 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.870572 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "63a1e4b6-8d7d-4890-aa71-78d9d1be897f" (UID: "63a1e4b6-8d7d-4890-aa71-78d9d1be897f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:13:32.870923 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.870847 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-workload-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:13:32.870923 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.870868 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-workload-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:13:32.871089 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.870954 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "63a1e4b6-8d7d-4890-aa71-78d9d1be897f" (UID: "63a1e4b6-8d7d-4890-aa71-78d9d1be897f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:13:32.871145 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.871085 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-data" (OuterVolumeSpecName: "istio-data") pod "63a1e4b6-8d7d-4890-aa71-78d9d1be897f" (UID: "63a1e4b6-8d7d-4890-aa71-78d9d1be897f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:13:32.871145 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.871094 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "63a1e4b6-8d7d-4890-aa71-78d9d1be897f" (UID: "63a1e4b6-8d7d-4890-aa71-78d9d1be897f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:13:32.872754 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.872716 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-token" (OuterVolumeSpecName: "istio-token") pod "63a1e4b6-8d7d-4890-aa71-78d9d1be897f" (UID: "63a1e4b6-8d7d-4890-aa71-78d9d1be897f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:13:32.872985 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.872842 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "63a1e4b6-8d7d-4890-aa71-78d9d1be897f" (UID: "63a1e4b6-8d7d-4890-aa71-78d9d1be897f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 15:13:32.872985 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.872865 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-kube-api-access-w44zw" (OuterVolumeSpecName: "kube-api-access-w44zw") pod "63a1e4b6-8d7d-4890-aa71-78d9d1be897f" (UID: "63a1e4b6-8d7d-4890-aa71-78d9d1be897f"). InnerVolumeSpecName "kube-api-access-w44zw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:13:32.873081 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.873051 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "63a1e4b6-8d7d-4890-aa71-78d9d1be897f" (UID: "63a1e4b6-8d7d-4890-aa71-78d9d1be897f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:13:32.971919 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.971880 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-data\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:13:32.971919 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.971915 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-credential-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:13:32.971919 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.971926 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-token\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:13:32.972162 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.971935 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w44zw\" (UniqueName: \"kubernetes.io/projected/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-kube-api-access-w44zw\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:13:32.972162 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.971944 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istiod-ca-cert\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:13:32.972162 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.971952 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-envoy\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:13:32.972162 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:32.971959 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63a1e4b6-8d7d-4890-aa71-78d9d1be897f-istio-podinfo\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:13:33.496757 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:33.496724 2565 generic.go:356] "Generic (PLEG): container finished" podID="63a1e4b6-8d7d-4890-aa71-78d9d1be897f" containerID="1e4e39854cd3c026627d533d6f906296c13be0d7f16f3ca168d1bfef01747232" exitCode=0 Jul 15 15:13:33.496974 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:33.496775 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" Jul 15 15:13:33.496974 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:33.496822 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" event={"ID":"63a1e4b6-8d7d-4890-aa71-78d9d1be897f","Type":"ContainerDied","Data":"1e4e39854cd3c026627d533d6f906296c13be0d7f16f3ca168d1bfef01747232"} Jul 15 15:13:33.496974 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:33.496874 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf" event={"ID":"63a1e4b6-8d7d-4890-aa71-78d9d1be897f","Type":"ContainerDied","Data":"0a2c6bcc7af1a57927cfb583e98a5c590ea37299571df4e3d0bcf194b8ac882b"} Jul 15 15:13:33.496974 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:33.496899 2565 scope.go:117] "RemoveContainer" containerID="1e4e39854cd3c026627d533d6f906296c13be0d7f16f3ca168d1bfef01747232" Jul 15 15:13:33.506084 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:33.506064 2565 scope.go:117] "RemoveContainer" containerID="9a2cf8e1f411692000f7a249b1ad4824dd2f950ed67dbef8abc3373f20096e49" Jul 15 15:13:33.513721 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:33.513702 2565 scope.go:117] "RemoveContainer" containerID="1e4e39854cd3c026627d533d6f906296c13be0d7f16f3ca168d1bfef01747232" Jul 15 15:13:33.514012 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:13:33.513993 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e4e39854cd3c026627d533d6f906296c13be0d7f16f3ca168d1bfef01747232\": container with ID starting with 1e4e39854cd3c026627d533d6f906296c13be0d7f16f3ca168d1bfef01747232 not found: ID does not exist" containerID="1e4e39854cd3c026627d533d6f906296c13be0d7f16f3ca168d1bfef01747232" Jul 15 15:13:33.514069 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:33.514020 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e4e39854cd3c026627d533d6f906296c13be0d7f16f3ca168d1bfef01747232"} err="failed to get container status \"1e4e39854cd3c026627d533d6f906296c13be0d7f16f3ca168d1bfef01747232\": rpc error: code = NotFound desc = could not find container \"1e4e39854cd3c026627d533d6f906296c13be0d7f16f3ca168d1bfef01747232\": container with ID starting with 1e4e39854cd3c026627d533d6f906296c13be0d7f16f3ca168d1bfef01747232 not found: ID does not exist" Jul 15 15:13:33.514069 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:33.514038 2565 scope.go:117] "RemoveContainer" containerID="9a2cf8e1f411692000f7a249b1ad4824dd2f950ed67dbef8abc3373f20096e49" Jul 15 15:13:33.514303 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:13:33.514285 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a2cf8e1f411692000f7a249b1ad4824dd2f950ed67dbef8abc3373f20096e49\": container with ID starting with 9a2cf8e1f411692000f7a249b1ad4824dd2f950ed67dbef8abc3373f20096e49 not found: ID does not exist" containerID="9a2cf8e1f411692000f7a249b1ad4824dd2f950ed67dbef8abc3373f20096e49" Jul 15 15:13:33.514358 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:33.514309 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a2cf8e1f411692000f7a249b1ad4824dd2f950ed67dbef8abc3373f20096e49"} err="failed to get container status \"9a2cf8e1f411692000f7a249b1ad4824dd2f950ed67dbef8abc3373f20096e49\": rpc error: code = NotFound desc = could not find container \"9a2cf8e1f411692000f7a249b1ad4824dd2f950ed67dbef8abc3373f20096e49\": container with ID starting with 9a2cf8e1f411692000f7a249b1ad4824dd2f950ed67dbef8abc3373f20096e49 not found: ID does not exist" Jul 15 15:13:33.517225 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:33.517202 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf"] Jul 15 15:13:33.523553 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:33.523531 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-0614af-openshift-default-6574bc4d5c-mzjwf"] Jul 15 15:13:34.676765 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:34.676728 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63a1e4b6-8d7d-4890-aa71-78d9d1be897f" path="/var/lib/kubelet/pods/63a1e4b6-8d7d-4890-aa71-78d9d1be897f/volumes" Jul 15 15:13:36.707255 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.707225 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf"] Jul 15 15:13:36.707615 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.707535 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63a1e4b6-8d7d-4890-aa71-78d9d1be897f" containerName="istio-proxy" Jul 15 15:13:36.707615 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.707547 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="63a1e4b6-8d7d-4890-aa71-78d9d1be897f" containerName="istio-proxy" Jul 15 15:13:36.707615 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.707556 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="791ea354-74db-463c-a703-4ab770efc49a" containerName="istio-proxy" Jul 15 15:13:36.707615 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.707562 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="791ea354-74db-463c-a703-4ab770efc49a" containerName="istio-proxy" Jul 15 15:13:36.707615 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.707570 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63a1e4b6-8d7d-4890-aa71-78d9d1be897f" containerName="istio-proxy" Jul 15 15:13:36.707615 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.707576 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="63a1e4b6-8d7d-4890-aa71-78d9d1be897f" containerName="istio-proxy" Jul 15 15:13:36.707875 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.707632 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="63a1e4b6-8d7d-4890-aa71-78d9d1be897f" containerName="istio-proxy" Jul 15 15:13:36.710544 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.710523 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.713333 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.713317 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-9f9f5c-openshift-default-dockercfg-5p9m4\"" Jul 15 15:13:36.722387 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.722363 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf"] Jul 15 15:13:36.809124 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.809053 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-workload-socket\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.809343 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.809318 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-data\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.809832 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.809782 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-podinfo\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.809947 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.809927 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-credential-socket\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.810004 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.809957 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istiod-ca-cert\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.810377 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.810047 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-envoy\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.810377 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.810098 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-workload-certs\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.810586 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.810490 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-token\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.810586 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.810539 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdqpv\" (UniqueName: \"kubernetes.io/projected/bb512b65-2578-4827-9ebf-e84b2dd2de7b-kube-api-access-zdqpv\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.912770 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.912735 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-envoy\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.912770 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.912775 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-workload-certs\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.913037 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.912791 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-token\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.913037 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.912830 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdqpv\" (UniqueName: \"kubernetes.io/projected/bb512b65-2578-4827-9ebf-e84b2dd2de7b-kube-api-access-zdqpv\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.913037 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.912890 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-workload-socket\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.913037 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.912909 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-data\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.913037 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.912940 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-podinfo\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.913037 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.912966 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-credential-socket\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.913037 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.912981 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istiod-ca-cert\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.913318 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.913251 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-workload-socket\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.913318 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.913266 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-workload-certs\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.913318 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.913299 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-data\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.913564 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.913540 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-credential-socket\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.913664 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.913647 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istiod-ca-cert\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.915331 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.915310 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-envoy\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.915458 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.915437 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-podinfo\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.920218 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.920192 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-token\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:36.920837 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:36.920793 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdqpv\" (UniqueName: \"kubernetes.io/projected/bb512b65-2578-4827-9ebf-e84b2dd2de7b-kube-api-access-zdqpv\") pod \"e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:37.021139 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:37.021045 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:37.153525 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:37.153477 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf"] Jul 15 15:13:37.155710 ip-10-0-136-155 kubenswrapper[2565]: W0715 15:13:37.155678 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb512b65_2578_4827_9ebf_e84b2dd2de7b.slice/crio-59ea5586c4028c385485f60d7bee5d814202ab18585f0156fe800237c5ff7af5 WatchSource:0}: Error finding container 59ea5586c4028c385485f60d7bee5d814202ab18585f0156fe800237c5ff7af5: Status 404 returned error can't find the container with id 59ea5586c4028c385485f60d7bee5d814202ab18585f0156fe800237c5ff7af5 Jul 15 15:13:37.158130 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:37.158088 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:13:37.158230 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:37.158178 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:13:37.158230 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:37.158218 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:13:37.517386 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:37.517350 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" event={"ID":"bb512b65-2578-4827-9ebf-e84b2dd2de7b","Type":"ContainerStarted","Data":"bbb8fd5bc41820c2f220409febccea73edb4f5a4a11a0dab5c1360518bf3d5c8"} Jul 15 15:13:37.517570 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:37.517401 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" event={"ID":"bb512b65-2578-4827-9ebf-e84b2dd2de7b","Type":"ContainerStarted","Data":"59ea5586c4028c385485f60d7bee5d814202ab18585f0156fe800237c5ff7af5"} Jul 15 15:13:37.537184 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:37.537122 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" podStartSLOduration=1.5371030829999999 podStartE2EDuration="1.537103083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:13:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:13:37.535865572 +0000 UTC m=+2577.408800132" watchObservedRunningTime="2026-07-15 15:13:37.537103083 +0000 UTC m=+2577.410037646" Jul 15 15:13:38.022183 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:38.022140 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:38.026880 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:38.026855 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:38.522671 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:38.522631 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:38.523526 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:38.523511 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:44.553647 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:44.553554 2565 generic.go:356] "Generic (PLEG): container finished" podID="e1526a72-82e3-4f02-a119-64300135b416" containerID="25f75d926f865fe28d703934d5185256609df3c52163654cb5ec00c26a5377e6" exitCode=0 Jul 15 15:13:44.553647 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:44.553632 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" event={"ID":"e1526a72-82e3-4f02-a119-64300135b416","Type":"ContainerDied","Data":"25f75d926f865fe28d703934d5185256609df3c52163654cb5ec00c26a5377e6"} Jul 15 15:13:44.554129 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:44.554112 2565 scope.go:117] "RemoveContainer" containerID="25f75d926f865fe28d703934d5185256609df3c52163654cb5ec00c26a5377e6" Jul 15 15:13:44.555144 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:44.555111 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:13:44.555255 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:44.555198 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:13:44.555255 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:44.555245 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:13:45.560616 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:45.560580 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" event={"ID":"e1526a72-82e3-4f02-a119-64300135b416","Type":"ContainerStarted","Data":"900534d0da5840dd3a4ec7996e9d04c7a44ad4865b4715800372343f94b72622"} Jul 15 15:13:45.832412 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:45.832309 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:45.833610 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:45.833575 2565 patch_prober.go:28] interesting pod/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 15 15:13:45.833733 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:45.833635 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" podUID="e1526a72-82e3-4f02-a119-64300135b416" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 15 15:13:46.487206 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:46.487150 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:46.832719 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:46.832635 2565 patch_prober.go:28] interesting pod/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 15 15:13:46.832719 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:46.832698 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" podUID="e1526a72-82e3-4f02-a119-64300135b416" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 15 15:13:47.832891 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:47.832852 2565 patch_prober.go:28] interesting pod/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 15 15:13:47.833305 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:47.832913 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" podUID="e1526a72-82e3-4f02-a119-64300135b416" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 15 15:13:48.831886 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:48.831855 2565 patch_prober.go:28] interesting pod/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 15 15:13:48.832150 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:48.832128 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" podUID="e1526a72-82e3-4f02-a119-64300135b416" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 15 15:13:49.832532 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:49.832503 2565 patch_prober.go:28] interesting pod/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 15 15:13:49.833035 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:49.833010 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" podUID="e1526a72-82e3-4f02-a119-64300135b416" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 15 15:13:50.857029 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:50.856987 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:50.859182 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:50.859154 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:13:53.524116 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:53.524082 2565 patch_prober.go:28] interesting pod/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 15 15:13:53.524537 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:53.524149 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" podUID="bb512b65-2578-4827-9ebf-e84b2dd2de7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 15 15:13:53.602734 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:53.602648 2565 generic.go:356] "Generic (PLEG): container finished" podID="bb512b65-2578-4827-9ebf-e84b2dd2de7b" containerID="bbb8fd5bc41820c2f220409febccea73edb4f5a4a11a0dab5c1360518bf3d5c8" exitCode=0 Jul 15 15:13:53.602734 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:53.602718 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" event={"ID":"bb512b65-2578-4827-9ebf-e84b2dd2de7b","Type":"ContainerDied","Data":"bbb8fd5bc41820c2f220409febccea73edb4f5a4a11a0dab5c1360518bf3d5c8"} Jul 15 15:13:53.603155 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:53.603135 2565 scope.go:117] "RemoveContainer" containerID="bbb8fd5bc41820c2f220409febccea73edb4f5a4a11a0dab5c1360518bf3d5c8" Jul 15 15:13:53.604221 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:53.604193 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:13:53.604311 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:53.604294 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:13:53.604349 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:53.604338 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 15:13:54.614265 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:54.614232 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" event={"ID":"bb512b65-2578-4827-9ebf-e84b2dd2de7b","Type":"ContainerStarted","Data":"0b5795483f6396739b8cdbaf1efe95c347d98d2c74f78f284debdc27cdfebd2f"} Jul 15 15:13:55.022035 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:55.021996 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:55.022340 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:55.022317 2565 patch_prober.go:28] interesting pod/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 15 15:13:55.022394 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:55.022372 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" podUID="bb512b65-2578-4827-9ebf-e84b2dd2de7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 15 15:13:56.022508 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:56.022466 2565 patch_prober.go:28] interesting pod/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 15 15:13:56.022946 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:56.022520 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" podUID="bb512b65-2578-4827-9ebf-e84b2dd2de7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 15 15:13:57.022110 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:57.022068 2565 patch_prober.go:28] interesting pod/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 15 15:13:57.022299 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:57.022125 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" podUID="bb512b65-2578-4827-9ebf-e84b2dd2de7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 15 15:13:58.022126 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:58.022087 2565 patch_prober.go:28] interesting pod/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 15 15:13:58.022592 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:58.022147 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" podUID="bb512b65-2578-4827-9ebf-e84b2dd2de7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 15 15:13:59.025819 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:59.025784 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:59.026379 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:59.026185 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:13:59.026944 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:13:59.026924 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:20:29.039604 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:29.039512 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs"] Jul 15 15:20:29.040094 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:29.039754 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" podUID="e1526a72-82e3-4f02-a119-64300135b416" containerName="istio-proxy" containerID="cri-o://900534d0da5840dd3a4ec7996e9d04c7a44ad4865b4715800372343f94b72622" gracePeriod=30 Jul 15 15:20:34.295359 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.295335 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:20:34.354308 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.354228 2565 generic.go:356] "Generic (PLEG): container finished" podID="e1526a72-82e3-4f02-a119-64300135b416" containerID="900534d0da5840dd3a4ec7996e9d04c7a44ad4865b4715800372343f94b72622" exitCode=0 Jul 15 15:20:34.354308 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.354280 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" Jul 15 15:20:34.354491 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.354316 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" event={"ID":"e1526a72-82e3-4f02-a119-64300135b416","Type":"ContainerDied","Data":"900534d0da5840dd3a4ec7996e9d04c7a44ad4865b4715800372343f94b72622"} Jul 15 15:20:34.354491 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.354371 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs" event={"ID":"e1526a72-82e3-4f02-a119-64300135b416","Type":"ContainerDied","Data":"af9eaac209e7d2638b39c689694f3eac2498ababf4e5b93685fa3c2b32aa7558"} Jul 15 15:20:34.354491 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.354398 2565 scope.go:117] "RemoveContainer" containerID="900534d0da5840dd3a4ec7996e9d04c7a44ad4865b4715800372343f94b72622" Jul 15 15:20:34.362605 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.362588 2565 scope.go:117] "RemoveContainer" containerID="25f75d926f865fe28d703934d5185256609df3c52163654cb5ec00c26a5377e6" Jul 15 15:20:34.370181 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.370164 2565 scope.go:117] "RemoveContainer" containerID="900534d0da5840dd3a4ec7996e9d04c7a44ad4865b4715800372343f94b72622" Jul 15 15:20:34.370444 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:20:34.370428 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"900534d0da5840dd3a4ec7996e9d04c7a44ad4865b4715800372343f94b72622\": container with ID starting with 900534d0da5840dd3a4ec7996e9d04c7a44ad4865b4715800372343f94b72622 not found: ID does not exist" containerID="900534d0da5840dd3a4ec7996e9d04c7a44ad4865b4715800372343f94b72622" Jul 15 15:20:34.370488 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.370454 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"900534d0da5840dd3a4ec7996e9d04c7a44ad4865b4715800372343f94b72622"} err="failed to get container status \"900534d0da5840dd3a4ec7996e9d04c7a44ad4865b4715800372343f94b72622\": rpc error: code = NotFound desc = could not find container \"900534d0da5840dd3a4ec7996e9d04c7a44ad4865b4715800372343f94b72622\": container with ID starting with 900534d0da5840dd3a4ec7996e9d04c7a44ad4865b4715800372343f94b72622 not found: ID does not exist" Jul 15 15:20:34.370488 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.370472 2565 scope.go:117] "RemoveContainer" containerID="25f75d926f865fe28d703934d5185256609df3c52163654cb5ec00c26a5377e6" Jul 15 15:20:34.370722 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:20:34.370705 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25f75d926f865fe28d703934d5185256609df3c52163654cb5ec00c26a5377e6\": container with ID starting with 25f75d926f865fe28d703934d5185256609df3c52163654cb5ec00c26a5377e6 not found: ID does not exist" containerID="25f75d926f865fe28d703934d5185256609df3c52163654cb5ec00c26a5377e6" Jul 15 15:20:34.370761 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.370733 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25f75d926f865fe28d703934d5185256609df3c52163654cb5ec00c26a5377e6"} err="failed to get container status \"25f75d926f865fe28d703934d5185256609df3c52163654cb5ec00c26a5377e6\": rpc error: code = NotFound desc = could not find container \"25f75d926f865fe28d703934d5185256609df3c52163654cb5ec00c26a5377e6\": container with ID starting with 25f75d926f865fe28d703934d5185256609df3c52163654cb5ec00c26a5377e6 not found: ID does not exist" Jul 15 15:20:34.436825 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.436767 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-istio-envoy\") pod \"e1526a72-82e3-4f02-a119-64300135b416\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " Jul 15 15:20:34.436961 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.436880 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wg9p9\" (UniqueName: \"kubernetes.io/projected/e1526a72-82e3-4f02-a119-64300135b416-kube-api-access-wg9p9\") pod \"e1526a72-82e3-4f02-a119-64300135b416\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " Jul 15 15:20:34.436961 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.436924 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-workload-socket\") pod \"e1526a72-82e3-4f02-a119-64300135b416\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " Jul 15 15:20:34.436961 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.436956 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-istio-data\") pod \"e1526a72-82e3-4f02-a119-64300135b416\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " Jul 15 15:20:34.437098 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.436984 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-workload-certs\") pod \"e1526a72-82e3-4f02-a119-64300135b416\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " Jul 15 15:20:34.437098 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.437026 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1526a72-82e3-4f02-a119-64300135b416-istio-token\") pod \"e1526a72-82e3-4f02-a119-64300135b416\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " Jul 15 15:20:34.437098 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.437061 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1526a72-82e3-4f02-a119-64300135b416-istio-podinfo\") pod \"e1526a72-82e3-4f02-a119-64300135b416\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " Jul 15 15:20:34.437098 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.437090 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1526a72-82e3-4f02-a119-64300135b416-istiod-ca-cert\") pod \"e1526a72-82e3-4f02-a119-64300135b416\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " Jul 15 15:20:34.437309 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.437129 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-credential-socket\") pod \"e1526a72-82e3-4f02-a119-64300135b416\" (UID: \"e1526a72-82e3-4f02-a119-64300135b416\") " Jul 15 15:20:34.437309 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.437237 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e1526a72-82e3-4f02-a119-64300135b416" (UID: "e1526a72-82e3-4f02-a119-64300135b416"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:20:34.437538 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.437474 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-workload-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:20:34.437538 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.437492 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e1526a72-82e3-4f02-a119-64300135b416" (UID: "e1526a72-82e3-4f02-a119-64300135b416"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:20:34.437728 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.437539 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1526a72-82e3-4f02-a119-64300135b416-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e1526a72-82e3-4f02-a119-64300135b416" (UID: "e1526a72-82e3-4f02-a119-64300135b416"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:20:34.437794 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.437739 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e1526a72-82e3-4f02-a119-64300135b416" (UID: "e1526a72-82e3-4f02-a119-64300135b416"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:20:34.437929 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.437896 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-istio-data" (OuterVolumeSpecName: "istio-data") pod "e1526a72-82e3-4f02-a119-64300135b416" (UID: "e1526a72-82e3-4f02-a119-64300135b416"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:20:34.439222 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.439186 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1526a72-82e3-4f02-a119-64300135b416-kube-api-access-wg9p9" (OuterVolumeSpecName: "kube-api-access-wg9p9") pod "e1526a72-82e3-4f02-a119-64300135b416" (UID: "e1526a72-82e3-4f02-a119-64300135b416"). InnerVolumeSpecName "kube-api-access-wg9p9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:20:34.439222 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.439196 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e1526a72-82e3-4f02-a119-64300135b416" (UID: "e1526a72-82e3-4f02-a119-64300135b416"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:20:34.439356 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.439251 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e1526a72-82e3-4f02-a119-64300135b416-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e1526a72-82e3-4f02-a119-64300135b416" (UID: "e1526a72-82e3-4f02-a119-64300135b416"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 15:20:34.439356 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.439308 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1526a72-82e3-4f02-a119-64300135b416-istio-token" (OuterVolumeSpecName: "istio-token") pod "e1526a72-82e3-4f02-a119-64300135b416" (UID: "e1526a72-82e3-4f02-a119-64300135b416"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:20:34.538482 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.538447 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1526a72-82e3-4f02-a119-64300135b416-istio-token\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:20:34.538482 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.538474 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1526a72-82e3-4f02-a119-64300135b416-istio-podinfo\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:20:34.538482 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.538483 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1526a72-82e3-4f02-a119-64300135b416-istiod-ca-cert\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:20:34.538482 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.538492 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-credential-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:20:34.538745 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.538502 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-istio-envoy\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:20:34.538745 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.538510 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wg9p9\" (UniqueName: \"kubernetes.io/projected/e1526a72-82e3-4f02-a119-64300135b416-kube-api-access-wg9p9\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:20:34.538745 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.538519 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-istio-data\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:20:34.538745 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.538526 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1526a72-82e3-4f02-a119-64300135b416-workload-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:20:34.677278 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.677231 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs"] Jul 15 15:20:34.679119 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:34.679097 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-e7a94a-openshift-default-67d7d6cb67-297bs"] Jul 15 15:20:36.676108 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:36.676077 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1526a72-82e3-4f02-a119-64300135b416" path="/var/lib/kubelet/pods/e1526a72-82e3-4f02-a119-64300135b416/volumes" Jul 15 15:20:55.125409 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:55.125371 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf"] Jul 15 15:20:55.449861 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:55.449788 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" podUID="bb512b65-2578-4827-9ebf-e84b2dd2de7b" containerName="istio-proxy" containerID="cri-o://0b5795483f6396739b8cdbaf1efe95c347d98d2c74f78f284debdc27cdfebd2f" gracePeriod=30 Jul 15 15:20:59.029111 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:59.029072 2565 patch_prober.go:28] interesting pod/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 15:20:59.029493 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:20:59.029141 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" podUID="bb512b65-2578-4827-9ebf-e84b2dd2de7b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 15:21:00.710666 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.710606 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:21:00.785737 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.785702 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-data\") pod \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " Jul 15 15:21:00.785935 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.785791 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-workload-certs\") pod \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " Jul 15 15:21:00.785935 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.785832 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-credential-socket\") pod \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " Jul 15 15:21:00.785935 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.785875 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-token\") pod \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " Jul 15 15:21:00.785935 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.785896 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-workload-socket\") pod \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " Jul 15 15:21:00.785935 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.785921 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdqpv\" (UniqueName: \"kubernetes.io/projected/bb512b65-2578-4827-9ebf-e84b2dd2de7b-kube-api-access-zdqpv\") pod \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " Jul 15 15:21:00.786209 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.785949 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istiod-ca-cert\") pod \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " Jul 15 15:21:00.786209 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.785982 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-podinfo\") pod \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " Jul 15 15:21:00.786209 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.786028 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-envoy\") pod \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\" (UID: \"bb512b65-2578-4827-9ebf-e84b2dd2de7b\") " Jul 15 15:21:00.786209 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.786070 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bb512b65-2578-4827-9ebf-e84b2dd2de7b" (UID: "bb512b65-2578-4827-9ebf-e84b2dd2de7b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:21:00.786419 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.786293 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-workload-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:21:00.786419 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.786323 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bb512b65-2578-4827-9ebf-e84b2dd2de7b" (UID: "bb512b65-2578-4827-9ebf-e84b2dd2de7b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:21:00.786535 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.786443 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bb512b65-2578-4827-9ebf-e84b2dd2de7b" (UID: "bb512b65-2578-4827-9ebf-e84b2dd2de7b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:21:00.786589 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.786553 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bb512b65-2578-4827-9ebf-e84b2dd2de7b" (UID: "bb512b65-2578-4827-9ebf-e84b2dd2de7b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:21:00.786634 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.786597 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-data" (OuterVolumeSpecName: "istio-data") pod "bb512b65-2578-4827-9ebf-e84b2dd2de7b" (UID: "bb512b65-2578-4827-9ebf-e84b2dd2de7b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:21:00.788237 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.788212 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb512b65-2578-4827-9ebf-e84b2dd2de7b-kube-api-access-zdqpv" (OuterVolumeSpecName: "kube-api-access-zdqpv") pod "bb512b65-2578-4827-9ebf-e84b2dd2de7b" (UID: "bb512b65-2578-4827-9ebf-e84b2dd2de7b"). InnerVolumeSpecName "kube-api-access-zdqpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:21:00.788237 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.788224 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bb512b65-2578-4827-9ebf-e84b2dd2de7b" (UID: "bb512b65-2578-4827-9ebf-e84b2dd2de7b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 15:21:00.788530 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.788501 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-token" (OuterVolumeSpecName: "istio-token") pod "bb512b65-2578-4827-9ebf-e84b2dd2de7b" (UID: "bb512b65-2578-4827-9ebf-e84b2dd2de7b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:21:00.788530 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.788520 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bb512b65-2578-4827-9ebf-e84b2dd2de7b" (UID: "bb512b65-2578-4827-9ebf-e84b2dd2de7b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:21:00.887282 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.887248 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-credential-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:21:00.887282 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.887277 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-token\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:21:00.887282 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.887287 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-workload-socket\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:21:00.887525 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.887296 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdqpv\" (UniqueName: \"kubernetes.io/projected/bb512b65-2578-4827-9ebf-e84b2dd2de7b-kube-api-access-zdqpv\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:21:00.887525 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.887304 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istiod-ca-cert\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:21:00.887525 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.887312 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-podinfo\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:21:00.887525 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.887319 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-envoy\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:21:00.887525 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:00.887327 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb512b65-2578-4827-9ebf-e84b2dd2de7b-istio-data\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 15 15:21:01.478887 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:01.478852 2565 generic.go:356] "Generic (PLEG): container finished" podID="bb512b65-2578-4827-9ebf-e84b2dd2de7b" containerID="0b5795483f6396739b8cdbaf1efe95c347d98d2c74f78f284debdc27cdfebd2f" exitCode=0 Jul 15 15:21:01.479101 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:01.478903 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" Jul 15 15:21:01.479101 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:01.478926 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" event={"ID":"bb512b65-2578-4827-9ebf-e84b2dd2de7b","Type":"ContainerDied","Data":"0b5795483f6396739b8cdbaf1efe95c347d98d2c74f78f284debdc27cdfebd2f"} Jul 15 15:21:01.479101 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:01.478968 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf" event={"ID":"bb512b65-2578-4827-9ebf-e84b2dd2de7b","Type":"ContainerDied","Data":"59ea5586c4028c385485f60d7bee5d814202ab18585f0156fe800237c5ff7af5"} Jul 15 15:21:01.479101 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:01.478988 2565 scope.go:117] "RemoveContainer" containerID="0b5795483f6396739b8cdbaf1efe95c347d98d2c74f78f284debdc27cdfebd2f" Jul 15 15:21:01.488124 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:01.488107 2565 scope.go:117] "RemoveContainer" containerID="bbb8fd5bc41820c2f220409febccea73edb4f5a4a11a0dab5c1360518bf3d5c8" Jul 15 15:21:01.496017 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:01.495999 2565 scope.go:117] "RemoveContainer" containerID="0b5795483f6396739b8cdbaf1efe95c347d98d2c74f78f284debdc27cdfebd2f" Jul 15 15:21:01.496305 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:21:01.496287 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b5795483f6396739b8cdbaf1efe95c347d98d2c74f78f284debdc27cdfebd2f\": container with ID starting with 0b5795483f6396739b8cdbaf1efe95c347d98d2c74f78f284debdc27cdfebd2f not found: ID does not exist" containerID="0b5795483f6396739b8cdbaf1efe95c347d98d2c74f78f284debdc27cdfebd2f" Jul 15 15:21:01.496349 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:01.496315 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b5795483f6396739b8cdbaf1efe95c347d98d2c74f78f284debdc27cdfebd2f"} err="failed to get container status \"0b5795483f6396739b8cdbaf1efe95c347d98d2c74f78f284debdc27cdfebd2f\": rpc error: code = NotFound desc = could not find container \"0b5795483f6396739b8cdbaf1efe95c347d98d2c74f78f284debdc27cdfebd2f\": container with ID starting with 0b5795483f6396739b8cdbaf1efe95c347d98d2c74f78f284debdc27cdfebd2f not found: ID does not exist" Jul 15 15:21:01.496349 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:01.496335 2565 scope.go:117] "RemoveContainer" containerID="bbb8fd5bc41820c2f220409febccea73edb4f5a4a11a0dab5c1360518bf3d5c8" Jul 15 15:21:01.496588 ip-10-0-136-155 kubenswrapper[2565]: E0715 15:21:01.496571 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbb8fd5bc41820c2f220409febccea73edb4f5a4a11a0dab5c1360518bf3d5c8\": container with ID starting with bbb8fd5bc41820c2f220409febccea73edb4f5a4a11a0dab5c1360518bf3d5c8 not found: ID does not exist" containerID="bbb8fd5bc41820c2f220409febccea73edb4f5a4a11a0dab5c1360518bf3d5c8" Jul 15 15:21:01.496638 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:01.496596 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbb8fd5bc41820c2f220409febccea73edb4f5a4a11a0dab5c1360518bf3d5c8"} err="failed to get container status \"bbb8fd5bc41820c2f220409febccea73edb4f5a4a11a0dab5c1360518bf3d5c8\": rpc error: code = NotFound desc = could not find container \"bbb8fd5bc41820c2f220409febccea73edb4f5a4a11a0dab5c1360518bf3d5c8\": container with ID starting with bbb8fd5bc41820c2f220409febccea73edb4f5a4a11a0dab5c1360518bf3d5c8 not found: ID does not exist" Jul 15 15:21:01.500271 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:01.500245 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf"] Jul 15 15:21:01.503834 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:01.503799 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-9f9f5c-openshift-default-788776dff-9n9rf"] Jul 15 15:21:01.936655 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:01.936626 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846b6d9d56-hhnkk_980c2a86-9caf-4804-b8da-362cdc1979b0/manager/0.log" Jul 15 15:21:01.942913 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:01.942894 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846b6d9d56-hhnkk_980c2a86-9caf-4804-b8da-362cdc1979b0/copy-manifests/0.log" Jul 15 15:21:02.676834 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:02.676790 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb512b65-2578-4827-9ebf-e84b2dd2de7b" path="/var/lib/kubelet/pods/bb512b65-2578-4827-9ebf-e84b2dd2de7b/volumes" Jul 15 15:21:06.560265 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:06.560235 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sqsgz_6f1ff8b3-07b8-4dca-b52a-90421a18781b/istio-proxy/0.log" Jul 15 15:21:06.676845 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:06.676793 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p6xt5_e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d/discovery/0.log" Jul 15 15:21:07.016871 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:07.016842 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-klmdm_41019b40-c6db-403e-a5eb-d43c17c37364/istio-proxy/1.log" Jul 15 15:21:07.858131 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:07.858103 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-7ltjp_baaed8ba-3cd2-4217-88b7-fb4a59aff923/main/0.log" Jul 15 15:21:08.089879 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:08.089849 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblwc4p_d302fc9b-1a8d-407a-b6ef-0695cfc32003/main/0.log" Jul 15 15:21:08.153864 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:08.153834 2565 patch_prober.go:28] interesting pod/image-registry-666fb5c6c8-9k4pw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 15:21:08.154035 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:08.153908 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" podUID="6c6eabc6-a1f2-4540-bc7c-3e78ca48be45" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 15:21:10.494444 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:10.494412 2565 patch_prober.go:28] interesting pod/image-registry-666fb5c6c8-9k4pw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 15:21:10.494833 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:10.494462 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-666fb5c6c8-9k4pw" podUID="6c6eabc6-a1f2-4540-bc7c-3e78ca48be45" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 15:21:17.241780 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:17.241751 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ddnm2_f1057e5f-10da-45d8-914f-2fec1ee7419b/global-pull-secret-syncer/0.log" Jul 15 15:21:17.441687 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:17.441658 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wjj78_6f13d742-97fe-4e14-b5a2-bbda928c3c2f/konnectivity-agent/0.log" Jul 15 15:21:17.487815 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:17.487773 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-155.ec2.internal_f671eeaf614c8d693fab4bd5bb741bfd/haproxy/0.log" Jul 15 15:21:24.591420 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:24.591347 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-847bc7dc4b-qgjnh_02b44e5c-0857-4b99-9182-74267fa3f19e/metrics-server/0.log" Jul 15 15:21:24.863965 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:24.863934 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sw6rl_2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9/node-exporter/0.log" Jul 15 15:21:24.903441 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:24.903413 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sw6rl_2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9/kube-rbac-proxy/0.log" Jul 15 15:21:24.927873 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:24.927848 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sw6rl_2d6bb4bd-3fbe-4c29-b0ac-041b46c699b9/init-textfile/0.log" Jul 15 15:21:25.058997 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:25.058970 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10f6ea4d-24ad-4390-9371-109812fbfa8b/prometheus/0.log" Jul 15 15:21:25.085898 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:25.085865 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10f6ea4d-24ad-4390-9371-109812fbfa8b/config-reloader/0.log" Jul 15 15:21:25.109621 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:25.109516 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10f6ea4d-24ad-4390-9371-109812fbfa8b/thanos-sidecar/0.log" Jul 15 15:21:25.135241 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:25.135194 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10f6ea4d-24ad-4390-9371-109812fbfa8b/kube-rbac-proxy-web/0.log" Jul 15 15:21:25.163722 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:25.163701 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10f6ea4d-24ad-4390-9371-109812fbfa8b/kube-rbac-proxy/0.log" Jul 15 15:21:25.189845 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:25.189798 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10f6ea4d-24ad-4390-9371-109812fbfa8b/kube-rbac-proxy-thanos/0.log" Jul 15 15:21:25.214512 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:25.214488 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10f6ea4d-24ad-4390-9371-109812fbfa8b/init-config-reloader/0.log" Jul 15 15:21:26.754432 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:26.754387 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-w2bd7_6a71156f-e1ae-440d-9a01-a22d53d505a0/networking-console-plugin/0.log" Jul 15 15:21:27.271546 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.271511 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr"] Jul 15 15:21:27.271883 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.271867 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1526a72-82e3-4f02-a119-64300135b416" containerName="istio-proxy" Jul 15 15:21:27.271941 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.271886 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1526a72-82e3-4f02-a119-64300135b416" containerName="istio-proxy" Jul 15 15:21:27.271941 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.271898 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1526a72-82e3-4f02-a119-64300135b416" containerName="istio-proxy" Jul 15 15:21:27.271941 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.271903 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1526a72-82e3-4f02-a119-64300135b416" containerName="istio-proxy" Jul 15 15:21:27.271941 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.271915 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb512b65-2578-4827-9ebf-e84b2dd2de7b" containerName="istio-proxy" Jul 15 15:21:27.271941 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.271921 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb512b65-2578-4827-9ebf-e84b2dd2de7b" containerName="istio-proxy" Jul 15 15:21:27.271941 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.271930 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb512b65-2578-4827-9ebf-e84b2dd2de7b" containerName="istio-proxy" Jul 15 15:21:27.271941 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.271935 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb512b65-2578-4827-9ebf-e84b2dd2de7b" containerName="istio-proxy" Jul 15 15:21:27.272147 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.272017 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1526a72-82e3-4f02-a119-64300135b416" containerName="istio-proxy" Jul 15 15:21:27.272147 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.272025 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb512b65-2578-4827-9ebf-e84b2dd2de7b" containerName="istio-proxy" Jul 15 15:21:27.272147 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.272033 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="63a1e4b6-8d7d-4890-aa71-78d9d1be897f" containerName="istio-proxy" Jul 15 15:21:27.272147 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.272044 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1526a72-82e3-4f02-a119-64300135b416" containerName="istio-proxy" Jul 15 15:21:27.276981 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.276933 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" Jul 15 15:21:27.279769 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.279748 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-96lvs\"/\"kube-root-ca.crt\"" Jul 15 15:21:27.280673 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.280649 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-96lvs\"/\"default-dockercfg-vpnlm\"" Jul 15 15:21:27.281078 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.281055 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-96lvs\"/\"openshift-service-ca.crt\"" Jul 15 15:21:27.282430 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.282412 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr"] Jul 15 15:21:27.318518 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.318481 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e2493a58-bb99-407c-babf-7220e41bdcf5-podres\") pod \"perf-node-gather-daemonset-ttdpr\" (UID: \"e2493a58-bb99-407c-babf-7220e41bdcf5\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" Jul 15 15:21:27.318712 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.318526 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvwld\" (UniqueName: \"kubernetes.io/projected/e2493a58-bb99-407c-babf-7220e41bdcf5-kube-api-access-xvwld\") pod \"perf-node-gather-daemonset-ttdpr\" (UID: \"e2493a58-bb99-407c-babf-7220e41bdcf5\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" Jul 15 15:21:27.318712 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.318557 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e2493a58-bb99-407c-babf-7220e41bdcf5-proc\") pod \"perf-node-gather-daemonset-ttdpr\" (UID: \"e2493a58-bb99-407c-babf-7220e41bdcf5\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" Jul 15 15:21:27.318712 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.318608 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2493a58-bb99-407c-babf-7220e41bdcf5-lib-modules\") pod \"perf-node-gather-daemonset-ttdpr\" (UID: \"e2493a58-bb99-407c-babf-7220e41bdcf5\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" Jul 15 15:21:27.318712 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.318690 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2493a58-bb99-407c-babf-7220e41bdcf5-sys\") pod \"perf-node-gather-daemonset-ttdpr\" (UID: \"e2493a58-bb99-407c-babf-7220e41bdcf5\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" Jul 15 15:21:27.419630 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.419598 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e2493a58-bb99-407c-babf-7220e41bdcf5-podres\") pod \"perf-node-gather-daemonset-ttdpr\" (UID: \"e2493a58-bb99-407c-babf-7220e41bdcf5\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" Jul 15 15:21:27.419630 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.419635 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvwld\" (UniqueName: \"kubernetes.io/projected/e2493a58-bb99-407c-babf-7220e41bdcf5-kube-api-access-xvwld\") pod \"perf-node-gather-daemonset-ttdpr\" (UID: \"e2493a58-bb99-407c-babf-7220e41bdcf5\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" Jul 15 15:21:27.419928 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.419656 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e2493a58-bb99-407c-babf-7220e41bdcf5-proc\") pod \"perf-node-gather-daemonset-ttdpr\" (UID: \"e2493a58-bb99-407c-babf-7220e41bdcf5\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" Jul 15 15:21:27.419928 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.419722 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e2493a58-bb99-407c-babf-7220e41bdcf5-proc\") pod \"perf-node-gather-daemonset-ttdpr\" (UID: \"e2493a58-bb99-407c-babf-7220e41bdcf5\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" Jul 15 15:21:27.419928 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.419748 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2493a58-bb99-407c-babf-7220e41bdcf5-lib-modules\") pod \"perf-node-gather-daemonset-ttdpr\" (UID: \"e2493a58-bb99-407c-babf-7220e41bdcf5\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" Jul 15 15:21:27.419928 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.419763 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e2493a58-bb99-407c-babf-7220e41bdcf5-podres\") pod \"perf-node-gather-daemonset-ttdpr\" (UID: \"e2493a58-bb99-407c-babf-7220e41bdcf5\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" Jul 15 15:21:27.419928 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.419797 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2493a58-bb99-407c-babf-7220e41bdcf5-sys\") pod \"perf-node-gather-daemonset-ttdpr\" (UID: \"e2493a58-bb99-407c-babf-7220e41bdcf5\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" Jul 15 15:21:27.419928 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.419877 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2493a58-bb99-407c-babf-7220e41bdcf5-lib-modules\") pod \"perf-node-gather-daemonset-ttdpr\" (UID: \"e2493a58-bb99-407c-babf-7220e41bdcf5\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" Jul 15 15:21:27.419928 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.419898 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2493a58-bb99-407c-babf-7220e41bdcf5-sys\") pod \"perf-node-gather-daemonset-ttdpr\" (UID: \"e2493a58-bb99-407c-babf-7220e41bdcf5\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" Jul 15 15:21:27.426569 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.426550 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvwld\" (UniqueName: \"kubernetes.io/projected/e2493a58-bb99-407c-babf-7220e41bdcf5-kube-api-access-xvwld\") pod \"perf-node-gather-daemonset-ttdpr\" (UID: \"e2493a58-bb99-407c-babf-7220e41bdcf5\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" Jul 15 15:21:27.588750 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.588673 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" Jul 15 15:21:27.721502 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:27.721477 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr"] Jul 15 15:21:27.724143 ip-10-0-136-155 kubenswrapper[2565]: W0715 15:21:27.724114 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode2493a58_bb99_407c_babf_7220e41bdcf5.slice/crio-1737a6b571734561f8a92e7f023cb031ab757cc27da43be23c51f81c58602c83 WatchSource:0}: Error finding container 1737a6b571734561f8a92e7f023cb031ab757cc27da43be23c51f81c58602c83: Status 404 returned error can't find the container with id 1737a6b571734561f8a92e7f023cb031ab757cc27da43be23c51f81c58602c83 Jul 15 15:21:28.593891 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:28.593858 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" event={"ID":"e2493a58-bb99-407c-babf-7220e41bdcf5","Type":"ContainerStarted","Data":"6314b4862ca9ddf435b9511d63d37cabdde2324b2edd700e14ae1db4bf29783d"} Jul 15 15:21:28.594270 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:28.593912 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" event={"ID":"e2493a58-bb99-407c-babf-7220e41bdcf5","Type":"ContainerStarted","Data":"1737a6b571734561f8a92e7f023cb031ab757cc27da43be23c51f81c58602c83"} Jul 15 15:21:28.594270 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:28.593933 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" Jul 15 15:21:28.611214 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:28.611162 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" podStartSLOduration=1.611146752 podStartE2EDuration="1.611146752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:21:28.609648329 +0000 UTC m=+3048.482582888" watchObservedRunningTime="2026-07-15 15:21:28.611146752 +0000 UTC m=+3048.484081311" Jul 15 15:21:29.711768 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:29.711743 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wdhdj_e5acfc7c-04db-4f37-9c8e-9476855d4508/dns/0.log" Jul 15 15:21:29.732572 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:29.732545 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wdhdj_e5acfc7c-04db-4f37-9c8e-9476855d4508/kube-rbac-proxy/0.log" Jul 15 15:21:29.780887 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:29.780857 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7gpxl_79dd4fed-463d-4100-8267-e2165857f17d/dns-node-resolver/0.log" Jul 15 15:21:30.319145 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:30.319109 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-666fb5c6c8-9k4pw_6c6eabc6-a1f2-4540-bc7c-3e78ca48be45/registry/0.log" Jul 15 15:21:30.392251 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:30.392219 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f5t4p_5f454a34-849a-4a48-bd4f-845c5bf5c3c8/node-ca/0.log" Jul 15 15:21:31.326920 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:31.326888 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sqsgz_6f1ff8b3-07b8-4dca-b52a-90421a18781b/istio-proxy/0.log" Jul 15 15:21:31.443822 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:31.443790 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p6xt5_e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d/discovery/0.log" Jul 15 15:21:31.528205 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:31.528173 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-klmdm_41019b40-c6db-403e-a5eb-d43c17c37364/istio-proxy/0.log" Jul 15 15:21:31.557324 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:31.557291 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-klmdm_41019b40-c6db-403e-a5eb-d43c17c37364/istio-proxy/1.log" Jul 15 15:21:32.390710 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:32.390637 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qd5nk_70955b42-9a85-4954-8234-3b3e1ed5192e/serve-healthcheck-canary/0.log" Jul 15 15:21:33.008819 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:33.008791 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p87cs_4afda59e-88f5-4b3a-9f2e-76325ee1d636/kube-rbac-proxy/0.log" Jul 15 15:21:33.033716 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:33.033690 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p87cs_4afda59e-88f5-4b3a-9f2e-76325ee1d636/exporter/0.log" Jul 15 15:21:33.056715 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:33.056688 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p87cs_4afda59e-88f5-4b3a-9f2e-76325ee1d636/extractor/0.log" Jul 15 15:21:34.608555 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:34.608529 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-ttdpr" Jul 15 15:21:35.970777 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:35.970748 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846b6d9d56-hhnkk_980c2a86-9caf-4804-b8da-362cdc1979b0/manager/0.log" Jul 15 15:21:35.998171 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:35.998146 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846b6d9d56-hhnkk_980c2a86-9caf-4804-b8da-362cdc1979b0/copy-manifests/0.log" Jul 15 15:21:37.456883 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:37.456856 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7bbc4984f8-cfng4_b7e96ebf-e571-442c-ae48-048cb234d8cd/manager/0.log" Jul 15 15:21:37.527235 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:37.527158 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sqsgz_6f1ff8b3-07b8-4dca-b52a-90421a18781b/istio-proxy/0.log" Jul 15 15:21:37.637621 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:37.637575 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p6xt5_e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d/discovery/0.log" Jul 15 15:21:37.682870 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:37.682842 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-klmdm_41019b40-c6db-403e-a5eb-d43c17c37364/istio-proxy/0.log" Jul 15 15:21:37.711232 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:37.711203 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-klmdm_41019b40-c6db-403e-a5eb-d43c17c37364/istio-proxy/1.log" Jul 15 15:21:38.994046 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:38.994017 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sqsgz_6f1ff8b3-07b8-4dca-b52a-90421a18781b/istio-proxy/0.log" Jul 15 15:21:39.107975 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:39.107888 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p6xt5_e5a1ffc9-e8dd-4b3f-857f-4bec32387b9d/discovery/0.log" Jul 15 15:21:39.163639 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:39.163593 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-klmdm_41019b40-c6db-403e-a5eb-d43c17c37364/istio-proxy/0.log" Jul 15 15:21:39.191285 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:39.191256 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-klmdm_41019b40-c6db-403e-a5eb-d43c17c37364/istio-proxy/1.log" Jul 15 15:21:42.499945 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:42.499911 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-sjhh8_0ac005bc-71bf-4ee6-b835-e26e4923ab4d/migrator/0.log" Jul 15 15:21:42.521607 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:42.521567 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-sjhh8_0ac005bc-71bf-4ee6-b835-e26e4923ab4d/graceful-termination/0.log" Jul 15 15:21:43.923047 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:43.923014 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4d7ml_085f819f-4469-41c0-8e1b-94b275ddac97/kube-multus/0.log" Jul 15 15:21:44.117457 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:44.117428 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l4w7p_95033e7d-b1fc-4636-8587-0303f98e3ded/kube-multus-additional-cni-plugins/0.log" Jul 15 15:21:44.139843 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:44.139799 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l4w7p_95033e7d-b1fc-4636-8587-0303f98e3ded/egress-router-binary-copy/0.log" Jul 15 15:21:44.162275 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:44.162247 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l4w7p_95033e7d-b1fc-4636-8587-0303f98e3ded/cni-plugins/0.log" Jul 15 15:21:44.185858 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:44.185766 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l4w7p_95033e7d-b1fc-4636-8587-0303f98e3ded/bond-cni-plugin/0.log" Jul 15 15:21:44.209607 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:44.209574 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l4w7p_95033e7d-b1fc-4636-8587-0303f98e3ded/routeoverride-cni/0.log" Jul 15 15:21:44.235102 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:44.235080 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l4w7p_95033e7d-b1fc-4636-8587-0303f98e3ded/whereabouts-cni-bincopy/0.log" Jul 15 15:21:44.257570 ip-10-0-136-155 kubenswrapper[2565]: I0715 15:21:44.257546 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l4w7p_95033e7d-b1fc-4636-8587-0303f98e3ded/whereabouts-cni/0.log"